[==========] Running 25 tests from 3 test suites.
[----------] Global test environment set-up.
[----------] 21 tests from TxnParticipantITest
[ RUN ] TxnParticipantITest.TestReplicateParticipantOps
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260615 08:03:57.094060 4267 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.42.254:45585
I20260615 08:03:57.094372 4267 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260615 08:03:57.094539 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:03:57.098580 4272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:03:57.098652 4275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:03:57.098629 4267 server_base.cc:1061] running on GCE node
W20260615 08:03:57.098661 4273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:03:57.098944 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:03:57.099009 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:03:57.099061 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510637099061 us; error 0 us; skew 500 ppm
I20260615 08:03:57.100004 4267 webserver.cc:533] Webserver started at http://127.4.42.254:42385/ using document root <none> and password file <none>
I20260615 08:03:57.100162 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:03:57.100227 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:03:57.100315 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:03:57.101279 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1781510637089012-4267-0/minicluster-data/master-0-root/instance:
uuid: "62cd3fb095d94aa3b3969e4c07799742"
format_stamp: "Formatted at 2026-06-15 08:03:57 on dist-test-slave-37n8"
I20260615 08:03:57.102587 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260615 08:03:57.103204 4280 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:03:57.103390 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260615 08:03:57.103462 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1781510637089012-4267-0/minicluster-data/master-0-root
uuid: "62cd3fb095d94aa3b3969e4c07799742"
format_stamp: "Formatted at 2026-06-15 08:03:57 on dist-test-slave-37n8"
I20260615 08:03:57.103518 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1781510637089012-4267-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1781510637089012-4267-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1781510637089012-4267-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:03:57.112587 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:03:57.112829 4267 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260615 08:03:57.112953 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:03:57.117165 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.254:45585
I20260615 08:03:57.117200 4332 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.254:45585 every 8 connection(s)
I20260615 08:03:57.117717 4333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:03:57.119992 4333 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62cd3fb095d94aa3b3969e4c07799742: Bootstrap starting.
I20260615 08:03:57.120746 4333 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 62cd3fb095d94aa3b3969e4c07799742: Neither blocks nor log segments found. Creating new log.
I20260615 08:03:57.120942 4333 log.cc:826] T 00000000000000000000000000000000 P 62cd3fb095d94aa3b3969e4c07799742: Log is configured to *not* fsync() on all Append() calls
I20260615 08:03:57.121430 4333 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62cd3fb095d94aa3b3969e4c07799742: No bootstrap required, opened a new log
I20260615 08:03:57.122601 4333 raft_consensus.cc:359] T 00000000000000000000000000000000 P 62cd3fb095d94aa3b3969e4c07799742 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62cd3fb095d94aa3b3969e4c07799742" member_type: VOTER }
I20260615 08:03:57.122687 4333 raft_consensus.cc:385] T 00000000000000000000000000000000 P 62cd3fb095d94aa3b3969e4c07799742 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:03:57.122705 4333 raft_consensus.cc:740] T 00000000000000000000000000000000 P 62cd3fb095d94aa3b3969e4c07799742 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62cd3fb095d94aa3b3969e4c07799742, State: Initialized, Role: FOLLOWER
I20260615 08:03:57.122778 4333 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62cd3fb095d94aa3b3969e4c07799742 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62cd3fb095d94aa3b3969e4c07799742" member_type: VOTER }
I20260615 08:03:57.122843 4333 raft_consensus.cc:399] T 00000000000000000000000000000000 P 62cd3fb095d94aa3b3969e4c07799742 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260615 08:03:57.122877 4333 raft_consensus.cc:493] T 00000000000000000000000000000000 P 62cd3fb095d94aa3b3969e4c07799742 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260615 08:03:57.122921 4333 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 62cd3fb095d94aa3b3969e4c07799742 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:03:57.123396 4333 raft_consensus.cc:515] T 00000000000000000000000000000000 P 62cd3fb095d94aa3b3969e4c07799742 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62cd3fb095d94aa3b3969e4c07799742" member_type: VOTER }
I20260615 08:03:57.123505 4333 leader_election.cc:304] T 00000000000000000000000000000000 P 62cd3fb095d94aa3b3969e4c07799742 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62cd3fb095d94aa3b3969e4c07799742; no voters:
I20260615 08:03:57.123659 4333 leader_election.cc:290] T 00000000000000000000000000000000 P 62cd3fb095d94aa3b3969e4c07799742 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260615 08:03:57.123709 4336 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 62cd3fb095d94aa3b3969e4c07799742 [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:03:57.123868 4336 raft_consensus.cc:697] T 00000000000000000000000000000000 P 62cd3fb095d94aa3b3969e4c07799742 [term 1 LEADER]: Becoming Leader. State: Replica: 62cd3fb095d94aa3b3969e4c07799742, State: Running, Role: LEADER
I20260615 08:03:57.123880 4333 sys_catalog.cc:565] T 00000000000000000000000000000000 P 62cd3fb095d94aa3b3969e4c07799742 [sys.catalog]: configured and running, proceeding with master startup.
I20260615 08:03:57.123989 4336 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62cd3fb095d94aa3b3969e4c07799742 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62cd3fb095d94aa3b3969e4c07799742" member_type: VOTER }
I20260615 08:03:57.124334 4337 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62cd3fb095d94aa3b3969e4c07799742 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "62cd3fb095d94aa3b3969e4c07799742" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62cd3fb095d94aa3b3969e4c07799742" member_type: VOTER } }
I20260615 08:03:57.124351 4338 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62cd3fb095d94aa3b3969e4c07799742 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62cd3fb095d94aa3b3969e4c07799742. Latest consensus state: current_term: 1 leader_uuid: "62cd3fb095d94aa3b3969e4c07799742" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62cd3fb095d94aa3b3969e4c07799742" member_type: VOTER } }
I20260615 08:03:57.124449 4337 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62cd3fb095d94aa3b3969e4c07799742 [sys.catalog]: This master's current role is: LEADER
I20260615 08:03:57.124468 4338 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62cd3fb095d94aa3b3969e4c07799742 [sys.catalog]: This master's current role is: LEADER
I20260615 08:03:57.125311 4267 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
W20260615 08:03:57.125643 4352 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 62cd3fb095d94aa3b3969e4c07799742: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260615 08:03:57.125680 4352 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260615 08:03:57.125738 4342 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260615 08:03:57.125938 4342 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260615 08:03:57.127090 4342 catalog_manager.cc:1382] Generated new cluster ID: be9d159b0293481db6b81a9bd68f3c4c
I20260615 08:03:57.127144 4342 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260615 08:03:57.141956 4342 catalog_manager.cc:1405] Generated new certificate authority record
I20260615 08:03:57.142447 4342 catalog_manager.cc:1539] Loading token signing keys...
I20260615 08:03:57.147719 4342 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 62cd3fb095d94aa3b3969e4c07799742: Generated new TSK 0
I20260615 08:03:57.147886 4342 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260615 08:03:57.157169 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:03:57.158692 4358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:03:57.158692 4355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:03:57.158797 4267 server_base.cc:1061] running on GCE node
W20260615 08:03:57.158650 4356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:03:57.159098 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:03:57.159138 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:03:57.159150 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510637159151 us; error 0 us; skew 500 ppm
I20260615 08:03:57.159758 4267 webserver.cc:533] Webserver started at http://127.4.42.193:43451/ using document root <none> and password file <none>
I20260615 08:03:57.159861 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:03:57.159911 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:03:57.159973 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:03:57.160226 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1781510637089012-4267-0/minicluster-data/ts-0-root/instance:
uuid: "490d76be012d4e12be22078bd72312a3"
format_stamp: "Formatted at 2026-06-15 08:03:57 on dist-test-slave-37n8"
I20260615 08:03:57.161126 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:03:57.161655 4363 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:03:57.161847 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:03:57.161913 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1781510637089012-4267-0/minicluster-data/ts-0-root
uuid: "490d76be012d4e12be22078bd72312a3"
format_stamp: "Formatted at 2026-06-15 08:03:57 on dist-test-slave-37n8"
I20260615 08:03:57.161959 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1781510637089012-4267-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1781510637089012-4267-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1781510637089012-4267-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:03:57.191727 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:03:57.192224 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:03:57.192451 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:03:57.192765 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:03:57.192819 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:03:57.192859 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:03:57.192902 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:03:57.197398 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.193:36923
I20260615 08:03:57.197495 4426 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.193:36923 every 8 connection(s)
I20260615 08:03:57.197837 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:03:57.199151 4431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:03:57.199288 4267 server_base.cc:1061] running on GCE node
W20260615 08:03:57.199177 4434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:03:57.200383 4432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:03:57.200549 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:03:57.200585 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:03:57.200603 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510637200604 us; error 0 us; skew 500 ppm
I20260615 08:03:57.201185 4267 webserver.cc:533] Webserver started at http://127.4.42.194:33895/ using document root <none> and password file <none>
I20260615 08:03:57.201267 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:03:57.201311 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:03:57.201356 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:03:57.201663 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1781510637089012-4267-0/minicluster-data/ts-1-root/instance:
uuid: "c4efacd17d8d40a8b70eb2f6dd213522"
format_stamp: "Formatted at 2026-06-15 08:03:57 on dist-test-slave-37n8"
I20260615 08:03:57.202805 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:03:57.203495 4439 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:03:57.203774 4267 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:03:57.203830 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1781510637089012-4267-0/minicluster-data/ts-1-root
uuid: "c4efacd17d8d40a8b70eb2f6dd213522"
format_stamp: "Formatted at 2026-06-15 08:03:57 on dist-test-slave-37n8"
I20260615 08:03:57.203874 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1781510637089012-4267-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1781510637089012-4267-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1781510637089012-4267-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:03:57.206728 4427 heartbeater.cc:344] Connected to a master server at 127.4.42.254:45585
I20260615 08:03:57.206828 4427 heartbeater.cc:461] Registering TS with master...
I20260615 08:03:57.206990 4427 heartbeater.cc:507] Master 127.4.42.254:45585 requested a full tablet report, sending...
I20260615 08:03:57.207444 4297 ts_manager.cc:194] Registered new tserver with Master: 490d76be012d4e12be22078bd72312a3 (127.4.42.193:36923)
I20260615 08:03:57.208367 4297 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59734
I20260615 08:03:57.217227 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:03:57.217543 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:03:57.217697 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:03:57.218003 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:03:57.218075 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:03:57.218122 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:03:57.218149 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:03:57.221356 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.194:43245
I20260615 08:03:57.221431 4502 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.194:43245 every 8 connection(s)
I20260615 08:03:57.221793 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:03:57.222908 4507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:03:57.223129 4506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:03:57.223541 4509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:03:57.223913 4267 server_base.cc:1061] running on GCE node
I20260615 08:03:57.224052 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:03:57.224112 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:03:57.224152 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510637224151 us; error 0 us; skew 500 ppm
I20260615 08:03:57.224759 4267 webserver.cc:533] Webserver started at http://127.4.42.195:38421/ using document root <none> and password file <none>
I20260615 08:03:57.224874 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:03:57.224925 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:03:57.224984 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:03:57.225274 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1781510637089012-4267-0/minicluster-data/ts-2-root/instance:
uuid: "4bb89b3a14e64784837a61e857cccf58"
format_stamp: "Formatted at 2026-06-15 08:03:57 on dist-test-slave-37n8"
I20260615 08:03:57.225487 4503 heartbeater.cc:344] Connected to a master server at 127.4.42.254:45585
I20260615 08:03:57.225545 4503 heartbeater.cc:461] Registering TS with master...
I20260615 08:03:57.225641 4503 heartbeater.cc:507] Master 127.4.42.254:45585 requested a full tablet report, sending...
I20260615 08:03:57.225888 4297 ts_manager.cc:194] Registered new tserver with Master: c4efacd17d8d40a8b70eb2f6dd213522 (127.4.42.194:43245)
I20260615 08:03:57.226390 4297 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59746
I20260615 08:03:57.226415 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:03:57.227018 4514 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:03:57.227155 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:03:57.227201 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1781510637089012-4267-0/minicluster-data/ts-2-root
uuid: "4bb89b3a14e64784837a61e857cccf58"
format_stamp: "Formatted at 2026-06-15 08:03:57 on dist-test-slave-37n8"
I20260615 08:03:57.227237 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1781510637089012-4267-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1781510637089012-4267-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestReplicateParticipantOps.1781510637089012-4267-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:03:57.250325 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:03:57.250653 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:03:57.250838 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:03:57.251053 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:03:57.251091 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:03:57.251119 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:03:57.251138 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:03:57.255458 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.195:35051
I20260615 08:03:57.255553 4577 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.195:35051 every 8 connection(s)
I20260615 08:03:57.259192 4578 heartbeater.cc:344] Connected to a master server at 127.4.42.254:45585
I20260615 08:03:57.259263 4578 heartbeater.cc:461] Registering TS with master...
I20260615 08:03:57.259359 4578 heartbeater.cc:507] Master 127.4.42.254:45585 requested a full tablet report, sending...
I20260615 08:03:57.259564 4297 ts_manager.cc:194] Registered new tserver with Master: 4bb89b3a14e64784837a61e857cccf58 (127.4.42.195:35051)
I20260615 08:03:57.259943 4297 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59750
I20260615 08:03:57.260119 4267 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.004436475s
I20260615 08:03:57.267634 4297 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59764:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260615 08:03:57.267899 4297 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260615 08:03:57.273737 4391 tablet_service.cc:1511] Processing CreateTablet for tablet 5f5333b33c3a4b52a1354128084fa091 (DEFAULT_TABLE table=test-workload [id=f61c87bbad9e4dd2b47dd62ce12ada56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:03:57.273936 4391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f5333b33c3a4b52a1354128084fa091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:03:57.274264 4467 tablet_service.cc:1511] Processing CreateTablet for tablet 5f5333b33c3a4b52a1354128084fa091 (DEFAULT_TABLE table=test-workload [id=f61c87bbad9e4dd2b47dd62ce12ada56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:03:57.274371 4467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f5333b33c3a4b52a1354128084fa091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:03:57.276152 4593 tablet_bootstrap.cc:492] T 5f5333b33c3a4b52a1354128084fa091 P c4efacd17d8d40a8b70eb2f6dd213522: Bootstrap starting.
I20260615 08:03:57.276641 4593 tablet_bootstrap.cc:654] T 5f5333b33c3a4b52a1354128084fa091 P c4efacd17d8d40a8b70eb2f6dd213522: Neither blocks nor log segments found. Creating new log.
I20260615 08:03:57.276801 4542 tablet_service.cc:1511] Processing CreateTablet for tablet 5f5333b33c3a4b52a1354128084fa091 (DEFAULT_TABLE table=test-workload [id=f61c87bbad9e4dd2b47dd62ce12ada56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:03:57.276912 4542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f5333b33c3a4b52a1354128084fa091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:03:57.277313 4593 tablet_bootstrap.cc:492] T 5f5333b33c3a4b52a1354128084fa091 P c4efacd17d8d40a8b70eb2f6dd213522: No bootstrap required, opened a new log
I20260615 08:03:57.277360 4593 ts_tablet_manager.cc:1403] T 5f5333b33c3a4b52a1354128084fa091 P c4efacd17d8d40a8b70eb2f6dd213522: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:03:57.277534 4593 raft_consensus.cc:359] T 5f5333b33c3a4b52a1354128084fa091 P c4efacd17d8d40a8b70eb2f6dd213522 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d76be012d4e12be22078bd72312a3" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 36923 } } peers { permanent_uuid: "c4efacd17d8d40a8b70eb2f6dd213522" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 43245 } } peers { permanent_uuid: "4bb89b3a14e64784837a61e857cccf58" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 35051 } }
I20260615 08:03:57.277601 4593 raft_consensus.cc:385] T 5f5333b33c3a4b52a1354128084fa091 P c4efacd17d8d40a8b70eb2f6dd213522 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:03:57.277621 4593 raft_consensus.cc:740] T 5f5333b33c3a4b52a1354128084fa091 P c4efacd17d8d40a8b70eb2f6dd213522 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4efacd17d8d40a8b70eb2f6dd213522, State: Initialized, Role: FOLLOWER
I20260615 08:03:57.277671 4593 consensus_queue.cc:260] T 5f5333b33c3a4b52a1354128084fa091 P c4efacd17d8d40a8b70eb2f6dd213522 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d76be012d4e12be22078bd72312a3" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 36923 } } peers { permanent_uuid: "c4efacd17d8d40a8b70eb2f6dd213522" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 43245 } } peers { permanent_uuid: "4bb89b3a14e64784837a61e857cccf58" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 35051 } }
I20260615 08:03:57.277865 4593 ts_tablet_manager.cc:1434] T 5f5333b33c3a4b52a1354128084fa091 P c4efacd17d8d40a8b70eb2f6dd213522: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260615 08:03:57.277928 4503 heartbeater.cc:499] Master 127.4.42.254:45585 was elected leader, sending a full tablet report...
I20260615 08:03:57.278379 4597 tablet_bootstrap.cc:492] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58: Bootstrap starting.
I20260615 08:03:57.279203 4597 tablet_bootstrap.cc:654] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58: Neither blocks nor log segments found. Creating new log.
I20260615 08:03:57.279861 4597 tablet_bootstrap.cc:492] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58: No bootstrap required, opened a new log
I20260615 08:03:57.279925 4597 ts_tablet_manager.cc:1403] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260615 08:03:57.280045 4597 raft_consensus.cc:359] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d76be012d4e12be22078bd72312a3" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 36923 } } peers { permanent_uuid: "c4efacd17d8d40a8b70eb2f6dd213522" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 43245 } } peers { permanent_uuid: "4bb89b3a14e64784837a61e857cccf58" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 35051 } }
I20260615 08:03:57.280109 4597 raft_consensus.cc:385] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:03:57.280143 4597 raft_consensus.cc:740] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bb89b3a14e64784837a61e857cccf58, State: Initialized, Role: FOLLOWER
I20260615 08:03:57.280189 4597 consensus_queue.cc:260] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d76be012d4e12be22078bd72312a3" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 36923 } } peers { permanent_uuid: "c4efacd17d8d40a8b70eb2f6dd213522" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 43245 } } peers { permanent_uuid: "4bb89b3a14e64784837a61e857cccf58" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 35051 } }
I20260615 08:03:57.280332 4597 ts_tablet_manager.cc:1434] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260615 08:03:57.280388 4578 heartbeater.cc:499] Master 127.4.42.254:45585 was elected leader, sending a full tablet report...
I20260615 08:03:57.282644 4594 tablet_bootstrap.cc:492] T 5f5333b33c3a4b52a1354128084fa091 P 490d76be012d4e12be22078bd72312a3: Bootstrap starting.
I20260615 08:03:57.283097 4594 tablet_bootstrap.cc:654] T 5f5333b33c3a4b52a1354128084fa091 P 490d76be012d4e12be22078bd72312a3: Neither blocks nor log segments found. Creating new log.
I20260615 08:03:57.283701 4594 tablet_bootstrap.cc:492] T 5f5333b33c3a4b52a1354128084fa091 P 490d76be012d4e12be22078bd72312a3: No bootstrap required, opened a new log
I20260615 08:03:57.283764 4594 ts_tablet_manager.cc:1403] T 5f5333b33c3a4b52a1354128084fa091 P 490d76be012d4e12be22078bd72312a3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:03:57.283897 4594 raft_consensus.cc:359] T 5f5333b33c3a4b52a1354128084fa091 P 490d76be012d4e12be22078bd72312a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d76be012d4e12be22078bd72312a3" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 36923 } } peers { permanent_uuid: "c4efacd17d8d40a8b70eb2f6dd213522" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 43245 } } peers { permanent_uuid: "4bb89b3a14e64784837a61e857cccf58" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 35051 } }
I20260615 08:03:57.283959 4594 raft_consensus.cc:385] T 5f5333b33c3a4b52a1354128084fa091 P 490d76be012d4e12be22078bd72312a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:03:57.283978 4594 raft_consensus.cc:740] T 5f5333b33c3a4b52a1354128084fa091 P 490d76be012d4e12be22078bd72312a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 490d76be012d4e12be22078bd72312a3, State: Initialized, Role: FOLLOWER
I20260615 08:03:57.284063 4594 consensus_queue.cc:260] T 5f5333b33c3a4b52a1354128084fa091 P 490d76be012d4e12be22078bd72312a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d76be012d4e12be22078bd72312a3" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 36923 } } peers { permanent_uuid: "c4efacd17d8d40a8b70eb2f6dd213522" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 43245 } } peers { permanent_uuid: "4bb89b3a14e64784837a61e857cccf58" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 35051 } }
I20260615 08:03:57.284224 4594 ts_tablet_manager.cc:1434] T 5f5333b33c3a4b52a1354128084fa091 P 490d76be012d4e12be22078bd72312a3: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260615 08:03:57.284248 4427 heartbeater.cc:499] Master 127.4.42.254:45585 was elected leader, sending a full tablet report...
W20260615 08:03:57.448035 4428 tablet.cc:2404] T 5f5333b33c3a4b52a1354128084fa091 P 490d76be012d4e12be22078bd72312a3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260615 08:03:57.473649 4599 raft_consensus.cc:493] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260615 08:03:57.473760 4599 raft_consensus.cc:515] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d76be012d4e12be22078bd72312a3" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 36923 } } peers { permanent_uuid: "c4efacd17d8d40a8b70eb2f6dd213522" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 43245 } } peers { permanent_uuid: "4bb89b3a14e64784837a61e857cccf58" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 35051 } }
I20260615 08:03:57.473992 4599 leader_election.cc:290] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 490d76be012d4e12be22078bd72312a3 (127.4.42.193:36923), c4efacd17d8d40a8b70eb2f6dd213522 (127.4.42.194:43245)
I20260615 08:03:57.476763 4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5333b33c3a4b52a1354128084fa091" candidate_uuid: "4bb89b3a14e64784837a61e857cccf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490d76be012d4e12be22078bd72312a3" is_pre_election: true
I20260615 08:03:57.476786 4477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5333b33c3a4b52a1354128084fa091" candidate_uuid: "4bb89b3a14e64784837a61e857cccf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4efacd17d8d40a8b70eb2f6dd213522" is_pre_election: true
I20260615 08:03:57.476886 4401 raft_consensus.cc:2468] T 5f5333b33c3a4b52a1354128084fa091 P 490d76be012d4e12be22078bd72312a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bb89b3a14e64784837a61e857cccf58 in term 0.
I20260615 08:03:57.476903 4477 raft_consensus.cc:2468] T 5f5333b33c3a4b52a1354128084fa091 P c4efacd17d8d40a8b70eb2f6dd213522 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4bb89b3a14e64784837a61e857cccf58 in term 0.
I20260615 08:03:57.477069 4515 leader_election.cc:304] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490d76be012d4e12be22078bd72312a3, 4bb89b3a14e64784837a61e857cccf58; no voters:
I20260615 08:03:57.477170 4599 raft_consensus.cc:2804] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260615 08:03:57.477236 4599 raft_consensus.cc:493] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:03:57.477263 4599 raft_consensus.cc:3060] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:03:57.477903 4599 raft_consensus.cc:515] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d76be012d4e12be22078bd72312a3" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 36923 } } peers { permanent_uuid: "c4efacd17d8d40a8b70eb2f6dd213522" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 43245 } } peers { permanent_uuid: "4bb89b3a14e64784837a61e857cccf58" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 35051 } }
I20260615 08:03:57.478048 4599 leader_election.cc:290] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58 [CANDIDATE]: Term 1 election: Requested vote from peers 490d76be012d4e12be22078bd72312a3 (127.4.42.193:36923), c4efacd17d8d40a8b70eb2f6dd213522 (127.4.42.194:43245)
I20260615 08:03:57.478169 4401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5333b33c3a4b52a1354128084fa091" candidate_uuid: "4bb89b3a14e64784837a61e857cccf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "490d76be012d4e12be22078bd72312a3"
I20260615 08:03:57.478229 4401 raft_consensus.cc:3060] T 5f5333b33c3a4b52a1354128084fa091 P 490d76be012d4e12be22078bd72312a3 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:03:57.478204 4477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5333b33c3a4b52a1354128084fa091" candidate_uuid: "4bb89b3a14e64784837a61e857cccf58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4efacd17d8d40a8b70eb2f6dd213522"
I20260615 08:03:57.478286 4477 raft_consensus.cc:3060] T 5f5333b33c3a4b52a1354128084fa091 P c4efacd17d8d40a8b70eb2f6dd213522 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:03:57.478871 4401 raft_consensus.cc:2468] T 5f5333b33c3a4b52a1354128084fa091 P 490d76be012d4e12be22078bd72312a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb89b3a14e64784837a61e857cccf58 in term 1.
I20260615 08:03:57.479040 4477 raft_consensus.cc:2468] T 5f5333b33c3a4b52a1354128084fa091 P c4efacd17d8d40a8b70eb2f6dd213522 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4bb89b3a14e64784837a61e857cccf58 in term 1.
I20260615 08:03:57.479046 4515 leader_election.cc:304] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490d76be012d4e12be22078bd72312a3, 4bb89b3a14e64784837a61e857cccf58; no voters:
I20260615 08:03:57.479176 4599 raft_consensus.cc:2804] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58 [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:03:57.479328 4599 raft_consensus.cc:697] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58 [term 1 LEADER]: Becoming Leader. State: Replica: 4bb89b3a14e64784837a61e857cccf58, State: Running, Role: LEADER
I20260615 08:03:57.479373 4599 consensus_queue.cc:237] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d76be012d4e12be22078bd72312a3" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 36923 } } peers { permanent_uuid: "c4efacd17d8d40a8b70eb2f6dd213522" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 43245 } } peers { permanent_uuid: "4bb89b3a14e64784837a61e857cccf58" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 35051 } }
I20260615 08:03:57.480036 4296 catalog_manager.cc:5696] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4bb89b3a14e64784837a61e857cccf58 (127.4.42.195). New cstate: current_term: 1 leader_uuid: "4bb89b3a14e64784837a61e857cccf58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d76be012d4e12be22078bd72312a3" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 36923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4efacd17d8d40a8b70eb2f6dd213522" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 43245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bb89b3a14e64784837a61e857cccf58" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 35051 } health_report { overall_health: HEALTHY } } }
I20260615 08:03:57.502895 4477 raft_consensus.cc:1275] T 5f5333b33c3a4b52a1354128084fa091 P c4efacd17d8d40a8b70eb2f6dd213522 [term 1 FOLLOWER]: Refusing update from remote peer 4bb89b3a14e64784837a61e857cccf58: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:03:57.502929 4401 raft_consensus.cc:1275] T 5f5333b33c3a4b52a1354128084fa091 P 490d76be012d4e12be22078bd72312a3 [term 1 FOLLOWER]: Refusing update from remote peer 4bb89b3a14e64784837a61e857cccf58: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:03:57.503153 4603 consensus_queue.cc:1048] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "490d76be012d4e12be22078bd72312a3" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 36923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:03:57.503243 4599 consensus_queue.cc:1048] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4efacd17d8d40a8b70eb2f6dd213522" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 43245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:03:57.504411 4610 mvcc.cc:204] Tried to move back new op lower bound from 7297067571209555968 to 7297067571116060672. Current Snapshot: MvccSnapshot[applied={T|T < 7297067571209555968}]
I20260615 08:04:07.983644 4643 raft_consensus.cc:993] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58: : Instructing follower 490d76be012d4e12be22078bd72312a3 to start an election
I20260615 08:04:07.983752 4643 raft_consensus.cc:1081] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58 [term 1 LEADER]: Signalling peer 490d76be012d4e12be22078bd72312a3 to start an election
I20260615 08:04:07.983990 4401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5f5333b33c3a4b52a1354128084fa091"
dest_uuid: "490d76be012d4e12be22078bd72312a3"
from {username='slave'} at 127.0.0.1:50202
I20260615 08:04:07.984076 4401 raft_consensus.cc:493] T 5f5333b33c3a4b52a1354128084fa091 P 490d76be012d4e12be22078bd72312a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260615 08:04:07.984097 4401 raft_consensus.cc:3060] T 5f5333b33c3a4b52a1354128084fa091 P 490d76be012d4e12be22078bd72312a3 [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:04:07.984754 4401 raft_consensus.cc:515] T 5f5333b33c3a4b52a1354128084fa091 P 490d76be012d4e12be22078bd72312a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d76be012d4e12be22078bd72312a3" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 36923 } } peers { permanent_uuid: "c4efacd17d8d40a8b70eb2f6dd213522" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 43245 } } peers { permanent_uuid: "4bb89b3a14e64784837a61e857cccf58" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 35051 } }
I20260615 08:04:07.984933 4401 leader_election.cc:290] T 5f5333b33c3a4b52a1354128084fa091 P 490d76be012d4e12be22078bd72312a3 [CANDIDATE]: Term 2 election: Requested vote from peers c4efacd17d8d40a8b70eb2f6dd213522 (127.4.42.194:43245), 4bb89b3a14e64784837a61e857cccf58 (127.4.42.195:35051)
I20260615 08:04:07.987723 4476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5333b33c3a4b52a1354128084fa091" candidate_uuid: "490d76be012d4e12be22078bd72312a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 13756 } } ignore_live_leader: true dest_uuid: "c4efacd17d8d40a8b70eb2f6dd213522"
I20260615 08:04:07.987807 4476 raft_consensus.cc:3060] T 5f5333b33c3a4b52a1354128084fa091 P c4efacd17d8d40a8b70eb2f6dd213522 [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:04:07.988368 4476 raft_consensus.cc:2468] T 5f5333b33c3a4b52a1354128084fa091 P c4efacd17d8d40a8b70eb2f6dd213522 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 490d76be012d4e12be22078bd72312a3 in term 2.
I20260615 08:04:07.988377 4552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f5333b33c3a4b52a1354128084fa091" candidate_uuid: "490d76be012d4e12be22078bd72312a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 13756 } } ignore_live_leader: true dest_uuid: "4bb89b3a14e64784837a61e857cccf58"
I20260615 08:04:07.988487 4552 raft_consensus.cc:3055] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58 [term 1 LEADER]: Stepping down as leader of term 1
I20260615 08:04:07.988523 4552 raft_consensus.cc:740] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4bb89b3a14e64784837a61e857cccf58, State: Running, Role: LEADER
I20260615 08:04:07.988590 4552 consensus_queue.cc:260] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13756, Committed index: 13756, Last appended: 1.13756, Last appended by leader: 13756, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d76be012d4e12be22078bd72312a3" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 36923 } } peers { permanent_uuid: "c4efacd17d8d40a8b70eb2f6dd213522" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 43245 } } peers { permanent_uuid: "4bb89b3a14e64784837a61e857cccf58" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 35051 } }
I20260615 08:04:07.988647 4367 leader_election.cc:304] T 5f5333b33c3a4b52a1354128084fa091 P 490d76be012d4e12be22078bd72312a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 490d76be012d4e12be22078bd72312a3, c4efacd17d8d40a8b70eb2f6dd213522; no voters:
I20260615 08:04:07.988708 4552 raft_consensus.cc:3060] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58 [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:04:07.988814 4651 raft_consensus.cc:2804] T 5f5333b33c3a4b52a1354128084fa091 P 490d76be012d4e12be22078bd72312a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260615 08:04:07.988969 4651 raft_consensus.cc:697] T 5f5333b33c3a4b52a1354128084fa091 P 490d76be012d4e12be22078bd72312a3 [term 2 LEADER]: Becoming Leader. State: Replica: 490d76be012d4e12be22078bd72312a3, State: Running, Role: LEADER
I20260615 08:04:07.989027 4651 consensus_queue.cc:237] T 5f5333b33c3a4b52a1354128084fa091 P 490d76be012d4e12be22078bd72312a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13756, Committed index: 13756, Last appended: 1.13756, Last appended by leader: 13756, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d76be012d4e12be22078bd72312a3" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 36923 } } peers { permanent_uuid: "c4efacd17d8d40a8b70eb2f6dd213522" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 43245 } } peers { permanent_uuid: "4bb89b3a14e64784837a61e857cccf58" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 35051 } }
I20260615 08:04:07.989423 4297 catalog_manager.cc:5696] T 5f5333b33c3a4b52a1354128084fa091 P 490d76be012d4e12be22078bd72312a3 reported cstate change: term changed from 1 to 2, leader changed from 4bb89b3a14e64784837a61e857cccf58 (127.4.42.195) to 490d76be012d4e12be22078bd72312a3 (127.4.42.193). New cstate: current_term: 2 leader_uuid: "490d76be012d4e12be22078bd72312a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "490d76be012d4e12be22078bd72312a3" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 36923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4efacd17d8d40a8b70eb2f6dd213522" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 43245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4bb89b3a14e64784837a61e857cccf58" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 35051 } health_report { overall_health: UNKNOWN } } }
I20260615 08:04:07.989517 4552 raft_consensus.cc:2468] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 490d76be012d4e12be22078bd72312a3 in term 2.
I20260615 08:04:07.991967 4552 raft_consensus.cc:1275] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58 [term 2 FOLLOWER]: Refusing update from remote peer 490d76be012d4e12be22078bd72312a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 13756. Preceding OpId from leader: term: 2 index: 13758. (index mismatch)
I20260615 08:04:07.992003 4476 raft_consensus.cc:1275] T 5f5333b33c3a4b52a1354128084fa091 P c4efacd17d8d40a8b70eb2f6dd213522 [term 2 FOLLOWER]: Refusing update from remote peer 490d76be012d4e12be22078bd72312a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 13756. Preceding OpId from leader: term: 2 index: 13758. (index mismatch)
I20260615 08:04:07.992255 4651 consensus_queue.cc:1048] T 5f5333b33c3a4b52a1354128084fa091 P 490d76be012d4e12be22078bd72312a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4efacd17d8d40a8b70eb2f6dd213522" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 43245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13757, Last known committed idx: 13756, Time since last communication: 0.000s
I20260615 08:04:07.992343 4652 consensus_queue.cc:1048] T 5f5333b33c3a4b52a1354128084fa091 P 490d76be012d4e12be22078bd72312a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bb89b3a14e64784837a61e857cccf58" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13757, Last known committed idx: 13756, Time since last communication: 0.000s
I20260615 08:04:07.998878 4267 tablet_server.cc:179] TabletServer@127.4.42.193:0 shutting down...
I20260615 08:04:08.001189 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:04:08.001299 4267 tablet_replica.cc:333] T 5f5333b33c3a4b52a1354128084fa091 P 490d76be012d4e12be22078bd72312a3: stopping tablet replica
I20260615 08:04:08.001367 4267 raft_consensus.cc:2243] T 5f5333b33c3a4b52a1354128084fa091 P 490d76be012d4e12be22078bd72312a3 [term 2 LEADER]: Raft consensus shutting down.
I20260615 08:04:08.001431 4267 raft_consensus.cc:2272] T 5f5333b33c3a4b52a1354128084fa091 P 490d76be012d4e12be22078bd72312a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:04:08.015339 4267 tablet_server.cc:196] TabletServer@127.4.42.193:0 shutdown complete.
I20260615 08:04:08.016173 4267 tablet_server.cc:179] TabletServer@127.4.42.194:0 shutting down...
I20260615 08:04:08.019217 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:04:08.019315 4267 tablet_replica.cc:333] T 5f5333b33c3a4b52a1354128084fa091 P c4efacd17d8d40a8b70eb2f6dd213522: stopping tablet replica
I20260615 08:04:08.019369 4267 raft_consensus.cc:2243] T 5f5333b33c3a4b52a1354128084fa091 P c4efacd17d8d40a8b70eb2f6dd213522 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260615 08:04:08.019407 4267 raft_consensus.cc:2272] T 5f5333b33c3a4b52a1354128084fa091 P c4efacd17d8d40a8b70eb2f6dd213522 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:04:08.039544 4267 tablet_server.cc:196] TabletServer@127.4.42.194:0 shutdown complete.
I20260615 08:04:08.040234 4267 tablet_server.cc:179] TabletServer@127.4.42.195:0 shutting down...
I20260615 08:04:08.042822 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:04:08.042948 4267 tablet_replica.cc:333] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58: stopping tablet replica
I20260615 08:04:08.043008 4267 raft_consensus.cc:2243] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260615 08:04:08.043053 4267 raft_consensus.cc:2272] T 5f5333b33c3a4b52a1354128084fa091 P 4bb89b3a14e64784837a61e857cccf58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:04:08.056587 4267 tablet_server.cc:196] TabletServer@127.4.42.195:0 shutdown complete.
I20260615 08:04:08.057299 4267 master.cc:562] Master@127.4.42.254:45585 shutting down...
I20260615 08:04:08.059950 4267 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 62cd3fb095d94aa3b3969e4c07799742 [term 1 LEADER]: Raft consensus shutting down.
I20260615 08:04:08.060006 4267 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 62cd3fb095d94aa3b3969e4c07799742 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:04:08.060027 4267 tablet_replica.cc:333] T 00000000000000000000000000000000 P 62cd3fb095d94aa3b3969e4c07799742: stopping tablet replica
I20260615 08:04:08.071514 4267 master.cc:584] Master@127.4.42.254:45585 shutdown complete.
[ OK ] TxnParticipantITest.TestReplicateParticipantOps (10995 ms)
[ RUN ] TxnParticipantITest.TestWaitOnFinalizeCommit
I20260615 08:04:08.089856 4267 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.42.254:36069
I20260615 08:04:08.090031 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:04:08.091166 4686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:04:08.091205 4683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:04:08.091382 4267 server_base.cc:1061] running on GCE node
W20260615 08:04:08.091223 4684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:04:08.091598 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:04:08.091661 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:04:08.091698 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510648091697 us; error 0 us; skew 500 ppm
I20260615 08:04:08.092221 4267 webserver.cc:533] Webserver started at http://127.4.42.254:35281/ using document root <none> and password file <none>
I20260615 08:04:08.092309 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:04:08.092355 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:04:08.092401 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:04:08.092648 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1781510637089012-4267-0/minicluster-data/master-0-root/instance:
uuid: "c7d4e743f05b4d18a8594a44188ec867"
format_stamp: "Formatted at 2026-06-15 08:04:08 on dist-test-slave-37n8"
I20260615 08:04:08.093530 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:04:08.094028 4691 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:08.094167 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:08.094223 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1781510637089012-4267-0/minicluster-data/master-0-root
uuid: "c7d4e743f05b4d18a8594a44188ec867"
format_stamp: "Formatted at 2026-06-15 08:04:08 on dist-test-slave-37n8"
I20260615 08:04:08.094269 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1781510637089012-4267-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1781510637089012-4267-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1781510637089012-4267-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:04:08.113040 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:04:08.113227 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:04:08.115847 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.254:36069
I20260615 08:04:08.128191 4743 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.254:36069 every 8 connection(s)
I20260615 08:04:08.128334 4744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:04:08.129256 4744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7d4e743f05b4d18a8594a44188ec867: Bootstrap starting.
I20260615 08:04:08.129535 4744 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c7d4e743f05b4d18a8594a44188ec867: Neither blocks nor log segments found. Creating new log.
I20260615 08:04:08.129999 4744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7d4e743f05b4d18a8594a44188ec867: No bootstrap required, opened a new log
I20260615 08:04:08.130133 4744 raft_consensus.cc:359] T 00000000000000000000000000000000 P c7d4e743f05b4d18a8594a44188ec867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7d4e743f05b4d18a8594a44188ec867" member_type: VOTER }
I20260615 08:04:08.130198 4744 raft_consensus.cc:385] T 00000000000000000000000000000000 P c7d4e743f05b4d18a8594a44188ec867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:04:08.130230 4744 raft_consensus.cc:740] T 00000000000000000000000000000000 P c7d4e743f05b4d18a8594a44188ec867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7d4e743f05b4d18a8594a44188ec867, State: Initialized, Role: FOLLOWER
I20260615 08:04:08.130283 4744 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7d4e743f05b4d18a8594a44188ec867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7d4e743f05b4d18a8594a44188ec867" member_type: VOTER }
I20260615 08:04:08.130321 4744 raft_consensus.cc:399] T 00000000000000000000000000000000 P c7d4e743f05b4d18a8594a44188ec867 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260615 08:04:08.130348 4744 raft_consensus.cc:493] T 00000000000000000000000000000000 P c7d4e743f05b4d18a8594a44188ec867 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260615 08:04:08.130375 4744 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c7d4e743f05b4d18a8594a44188ec867 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:04:08.130887 4744 raft_consensus.cc:515] T 00000000000000000000000000000000 P c7d4e743f05b4d18a8594a44188ec867 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7d4e743f05b4d18a8594a44188ec867" member_type: VOTER }
I20260615 08:04:08.130961 4744 leader_election.cc:304] T 00000000000000000000000000000000 P c7d4e743f05b4d18a8594a44188ec867 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c7d4e743f05b4d18a8594a44188ec867; no voters:
I20260615 08:04:08.131065 4744 leader_election.cc:290] T 00000000000000000000000000000000 P c7d4e743f05b4d18a8594a44188ec867 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260615 08:04:08.131100 4747 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c7d4e743f05b4d18a8594a44188ec867 [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:04:08.131227 4744 sys_catalog.cc:565] T 00000000000000000000000000000000 P c7d4e743f05b4d18a8594a44188ec867 [sys.catalog]: configured and running, proceeding with master startup.
I20260615 08:04:08.131245 4747 raft_consensus.cc:697] T 00000000000000000000000000000000 P c7d4e743f05b4d18a8594a44188ec867 [term 1 LEADER]: Becoming Leader. State: Replica: c7d4e743f05b4d18a8594a44188ec867, State: Running, Role: LEADER
I20260615 08:04:08.131289 4747 consensus_queue.cc:237] T 00000000000000000000000000000000 P c7d4e743f05b4d18a8594a44188ec867 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7d4e743f05b4d18a8594a44188ec867" member_type: VOTER }
I20260615 08:04:08.131465 4748 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7d4e743f05b4d18a8594a44188ec867 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c7d4e743f05b4d18a8594a44188ec867" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7d4e743f05b4d18a8594a44188ec867" member_type: VOTER } }
I20260615 08:04:08.131476 4749 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7d4e743f05b4d18a8594a44188ec867 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c7d4e743f05b4d18a8594a44188ec867. Latest consensus state: current_term: 1 leader_uuid: "c7d4e743f05b4d18a8594a44188ec867" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7d4e743f05b4d18a8594a44188ec867" member_type: VOTER } }
I20260615 08:04:08.131541 4748 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7d4e743f05b4d18a8594a44188ec867 [sys.catalog]: This master's current role is: LEADER
I20260615 08:04:08.131604 4749 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7d4e743f05b4d18a8594a44188ec867 [sys.catalog]: This master's current role is: LEADER
I20260615 08:04:08.131701 4751 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260615 08:04:08.131858 4751 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260615 08:04:08.132448 4751 catalog_manager.cc:1382] Generated new cluster ID: 63c896da367c45d6b498124b7c84d382
I20260615 08:04:08.132493 4751 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260615 08:04:08.132551 4267 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260615 08:04:08.147917 4751 catalog_manager.cc:1405] Generated new certificate authority record
I20260615 08:04:08.148342 4751 catalog_manager.cc:1539] Loading token signing keys...
I20260615 08:04:08.159157 4751 catalog_manager.cc:6069] T 00000000000000000000000000000000 P c7d4e743f05b4d18a8594a44188ec867: Generated new TSK 0
I20260615 08:04:08.159262 4751 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260615 08:04:08.164258 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:04:08.165427 4766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:04:08.165438 4765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:04:08.165563 4768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:04:08.165678 4267 server_base.cc:1061] running on GCE node
I20260615 08:04:08.165756 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:04:08.165786 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:04:08.165812 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510648165811 us; error 0 us; skew 500 ppm
I20260615 08:04:08.166352 4267 webserver.cc:533] Webserver started at http://127.4.42.193:39923/ using document root <none> and password file <none>
I20260615 08:04:08.166569 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:04:08.166635 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:04:08.166687 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:04:08.166955 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1781510637089012-4267-0/minicluster-data/ts-0-root/instance:
uuid: "d09d9fb8020b43e18eb1dc003400cdd6"
format_stamp: "Formatted at 2026-06-15 08:04:08 on dist-test-slave-37n8"
I20260615 08:04:08.167790 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:04:08.168227 4773 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:08.168383 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:08.168440 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1781510637089012-4267-0/minicluster-data/ts-0-root
uuid: "d09d9fb8020b43e18eb1dc003400cdd6"
format_stamp: "Formatted at 2026-06-15 08:04:08 on dist-test-slave-37n8"
I20260615 08:04:08.168485 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1781510637089012-4267-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1781510637089012-4267-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1781510637089012-4267-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:04:08.181222 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:04:08.181424 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:04:08.181569 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:04:08.181757 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:04:08.181802 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:08.181840 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:04:08.181866 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:08.184578 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.193:34597
I20260615 08:04:08.184629 4836 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.193:34597 every 8 connection(s)
I20260615 08:04:08.184962 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:04:08.185942 4841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:04:08.185977 4842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:04:08.186368 4267 server_base.cc:1061] running on GCE node
W20260615 08:04:08.186894 4844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:04:08.187067 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:04:08.187109 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:04:08.187122 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510648187123 us; error 0 us; skew 500 ppm
I20260615 08:04:08.187678 4267 webserver.cc:533] Webserver started at http://127.4.42.194:44175/ using document root <none> and password file <none>
I20260615 08:04:08.187767 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:04:08.187819 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:04:08.187867 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:04:08.188109 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1781510637089012-4267-0/minicluster-data/ts-1-root/instance:
uuid: "f13ce792b555451eaf86624997475e9b"
format_stamp: "Formatted at 2026-06-15 08:04:08 on dist-test-slave-37n8"
I20260615 08:04:08.188527 4837 heartbeater.cc:344] Connected to a master server at 127.4.42.254:36069
I20260615 08:04:08.188589 4837 heartbeater.cc:461] Registering TS with master...
I20260615 08:04:08.188689 4837 heartbeater.cc:507] Master 127.4.42.254:36069 requested a full tablet report, sending...
I20260615 08:04:08.188933 4708 ts_manager.cc:194] Registered new tserver with Master: d09d9fb8020b43e18eb1dc003400cdd6 (127.4.42.193:34597)
I20260615 08:04:08.189512 4708 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35566
I20260615 08:04:08.189749 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:04:08.190210 4849 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:08.190335 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:08.190383 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1781510637089012-4267-0/minicluster-data/ts-1-root
uuid: "f13ce792b555451eaf86624997475e9b"
format_stamp: "Formatted at 2026-06-15 08:04:08 on dist-test-slave-37n8"
I20260615 08:04:08.190428 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1781510637089012-4267-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1781510637089012-4267-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1781510637089012-4267-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:04:08.197144 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:04:08.197295 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:04:08.197388 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:04:08.197517 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:04:08.197539 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:08.197556 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:04:08.197568 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:08.200387 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.194:34227
I20260615 08:04:08.200431 4913 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.194:34227 every 8 connection(s)
I20260615 08:04:08.200742 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:04:08.201689 4917 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:04:08.201884 4918 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:04:08.202028 4920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:04:08.202145 4267 server_base.cc:1061] running on GCE node
I20260615 08:04:08.202265 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:04:08.202327 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:04:08.202353 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510648202353 us; error 0 us; skew 500 ppm
I20260615 08:04:08.202883 4267 webserver.cc:533] Webserver started at http://127.4.42.195:41471/ using document root <none> and password file <none>
I20260615 08:04:08.202977 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:04:08.203023 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:04:08.203074 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:04:08.203336 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1781510637089012-4267-0/minicluster-data/ts-2-root/instance:
uuid: "843e05afc19d44f997773e5988dd6fe8"
format_stamp: "Formatted at 2026-06-15 08:04:08 on dist-test-slave-37n8"
I20260615 08:04:08.203962 4914 heartbeater.cc:344] Connected to a master server at 127.4.42.254:36069
I20260615 08:04:08.204030 4914 heartbeater.cc:461] Registering TS with master...
I20260615 08:04:08.204130 4914 heartbeater.cc:507] Master 127.4.42.254:36069 requested a full tablet report, sending...
I20260615 08:04:08.204360 4708 ts_manager.cc:194] Registered new tserver with Master: f13ce792b555451eaf86624997475e9b (127.4.42.194:34227)
I20260615 08:04:08.204483 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:04:08.204813 4708 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35578
I20260615 08:04:08.204998 4925 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:08.205113 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:08.205163 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1781510637089012-4267-0/minicluster-data/ts-2-root
uuid: "843e05afc19d44f997773e5988dd6fe8"
format_stamp: "Formatted at 2026-06-15 08:04:08 on dist-test-slave-37n8"
I20260615 08:04:08.205205 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1781510637089012-4267-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1781510637089012-4267-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnFinalizeCommit.1781510637089012-4267-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:04:08.212014 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:04:08.212224 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:04:08.212380 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:04:08.212582 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:04:08.212610 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:08.212627 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:04:08.212669 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:08.215801 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.195:34233
I20260615 08:04:08.215854 4988 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.195:34233 every 8 connection(s)
I20260615 08:04:08.218406 4989 heartbeater.cc:344] Connected to a master server at 127.4.42.254:36069
I20260615 08:04:08.218451 4989 heartbeater.cc:461] Registering TS with master...
I20260615 08:04:08.218566 4989 heartbeater.cc:507] Master 127.4.42.254:36069 requested a full tablet report, sending...
I20260615 08:04:08.218734 4708 ts_manager.cc:194] Registered new tserver with Master: 843e05afc19d44f997773e5988dd6fe8 (127.4.42.195:34233)
I20260615 08:04:08.219014 4708 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35594
I20260615 08:04:08.219306 4267 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003343401s
I20260615 08:04:08.223907 4708 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35610:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260615 08:04:08.224077 4708 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260615 08:04:08.228569 4801 tablet_service.cc:1511] Processing CreateTablet for tablet 259dcc77d81e45bda6f6874a27a3fab4 (DEFAULT_TABLE table=test-workload [id=8770fd0ecf094fd7bd0a848d65c13aae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:04:08.228688 4801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 259dcc77d81e45bda6f6874a27a3fab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:04:08.228919 4878 tablet_service.cc:1511] Processing CreateTablet for tablet 259dcc77d81e45bda6f6874a27a3fab4 (DEFAULT_TABLE table=test-workload [id=8770fd0ecf094fd7bd0a848d65c13aae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:04:08.228960 4953 tablet_service.cc:1511] Processing CreateTablet for tablet 259dcc77d81e45bda6f6874a27a3fab4 (DEFAULT_TABLE table=test-workload [id=8770fd0ecf094fd7bd0a848d65c13aae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:04:08.229018 4878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 259dcc77d81e45bda6f6874a27a3fab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:04:08.229045 4953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 259dcc77d81e45bda6f6874a27a3fab4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:04:08.230059 5004 tablet_bootstrap.cc:492] T 259dcc77d81e45bda6f6874a27a3fab4 P f13ce792b555451eaf86624997475e9b: Bootstrap starting.
I20260615 08:04:08.230244 5005 tablet_bootstrap.cc:492] T 259dcc77d81e45bda6f6874a27a3fab4 P d09d9fb8020b43e18eb1dc003400cdd6: Bootstrap starting.
I20260615 08:04:08.230520 5004 tablet_bootstrap.cc:654] T 259dcc77d81e45bda6f6874a27a3fab4 P f13ce792b555451eaf86624997475e9b: Neither blocks nor log segments found. Creating new log.
I20260615 08:04:08.230571 5006 tablet_bootstrap.cc:492] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8: Bootstrap starting.
I20260615 08:04:08.230741 5005 tablet_bootstrap.cc:654] T 259dcc77d81e45bda6f6874a27a3fab4 P d09d9fb8020b43e18eb1dc003400cdd6: Neither blocks nor log segments found. Creating new log.
I20260615 08:04:08.231043 5006 tablet_bootstrap.cc:654] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8: Neither blocks nor log segments found. Creating new log.
I20260615 08:04:08.231374 5005 tablet_bootstrap.cc:492] T 259dcc77d81e45bda6f6874a27a3fab4 P d09d9fb8020b43e18eb1dc003400cdd6: No bootstrap required, opened a new log
I20260615 08:04:08.231439 5005 ts_tablet_manager.cc:1403] T 259dcc77d81e45bda6f6874a27a3fab4 P d09d9fb8020b43e18eb1dc003400cdd6: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260615 08:04:08.231616 5004 tablet_bootstrap.cc:492] T 259dcc77d81e45bda6f6874a27a3fab4 P f13ce792b555451eaf86624997475e9b: No bootstrap required, opened a new log
I20260615 08:04:08.231595 5005 raft_consensus.cc:359] T 259dcc77d81e45bda6f6874a27a3fab4 P d09d9fb8020b43e18eb1dc003400cdd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d09d9fb8020b43e18eb1dc003400cdd6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 34597 } } peers { permanent_uuid: "f13ce792b555451eaf86624997475e9b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 34227 } } peers { permanent_uuid: "843e05afc19d44f997773e5988dd6fe8" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 34233 } }
I20260615 08:04:08.231599 5006 tablet_bootstrap.cc:492] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8: No bootstrap required, opened a new log
I20260615 08:04:08.231693 5004 ts_tablet_manager.cc:1403] T 259dcc77d81e45bda6f6874a27a3fab4 P f13ce792b555451eaf86624997475e9b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260615 08:04:08.231734 5006 ts_tablet_manager.cc:1403] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260615 08:04:08.231844 5004 raft_consensus.cc:359] T 259dcc77d81e45bda6f6874a27a3fab4 P f13ce792b555451eaf86624997475e9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d09d9fb8020b43e18eb1dc003400cdd6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 34597 } } peers { permanent_uuid: "f13ce792b555451eaf86624997475e9b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 34227 } } peers { permanent_uuid: "843e05afc19d44f997773e5988dd6fe8" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 34233 } }
I20260615 08:04:08.231901 5004 raft_consensus.cc:385] T 259dcc77d81e45bda6f6874a27a3fab4 P f13ce792b555451eaf86624997475e9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:04:08.231887 5006 raft_consensus.cc:359] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d09d9fb8020b43e18eb1dc003400cdd6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 34597 } } peers { permanent_uuid: "f13ce792b555451eaf86624997475e9b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 34227 } } peers { permanent_uuid: "843e05afc19d44f997773e5988dd6fe8" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 34233 } }
I20260615 08:04:08.231922 5004 raft_consensus.cc:740] T 259dcc77d81e45bda6f6874a27a3fab4 P f13ce792b555451eaf86624997475e9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f13ce792b555451eaf86624997475e9b, State: Initialized, Role: FOLLOWER
I20260615 08:04:08.231936 5006 raft_consensus.cc:385] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:04:08.231958 5006 raft_consensus.cc:740] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 843e05afc19d44f997773e5988dd6fe8, State: Initialized, Role: FOLLOWER
I20260615 08:04:08.231966 5004 consensus_queue.cc:260] T 259dcc77d81e45bda6f6874a27a3fab4 P f13ce792b555451eaf86624997475e9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d09d9fb8020b43e18eb1dc003400cdd6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 34597 } } peers { permanent_uuid: "f13ce792b555451eaf86624997475e9b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 34227 } } peers { permanent_uuid: "843e05afc19d44f997773e5988dd6fe8" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 34233 } }
I20260615 08:04:08.232016 5006 consensus_queue.cc:260] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d09d9fb8020b43e18eb1dc003400cdd6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 34597 } } peers { permanent_uuid: "f13ce792b555451eaf86624997475e9b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 34227 } } peers { permanent_uuid: "843e05afc19d44f997773e5988dd6fe8" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 34233 } }
I20260615 08:04:08.232132 5004 ts_tablet_manager.cc:1434] T 259dcc77d81e45bda6f6874a27a3fab4 P f13ce792b555451eaf86624997475e9b: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260615 08:04:08.232165 5006 ts_tablet_manager.cc:1434] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:08.232197 4989 heartbeater.cc:499] Master 127.4.42.254:36069 was elected leader, sending a full tablet report...
I20260615 08:04:08.232224 4914 heartbeater.cc:499] Master 127.4.42.254:36069 was elected leader, sending a full tablet report...
I20260615 08:04:08.231693 5005 raft_consensus.cc:385] T 259dcc77d81e45bda6f6874a27a3fab4 P d09d9fb8020b43e18eb1dc003400cdd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:04:08.232270 5005 raft_consensus.cc:740] T 259dcc77d81e45bda6f6874a27a3fab4 P d09d9fb8020b43e18eb1dc003400cdd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d09d9fb8020b43e18eb1dc003400cdd6, State: Initialized, Role: FOLLOWER
I20260615 08:04:08.232317 5005 consensus_queue.cc:260] T 259dcc77d81e45bda6f6874a27a3fab4 P d09d9fb8020b43e18eb1dc003400cdd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d09d9fb8020b43e18eb1dc003400cdd6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 34597 } } peers { permanent_uuid: "f13ce792b555451eaf86624997475e9b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 34227 } } peers { permanent_uuid: "843e05afc19d44f997773e5988dd6fe8" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 34233 } }
I20260615 08:04:08.232473 5005 ts_tablet_manager.cc:1434] T 259dcc77d81e45bda6f6874a27a3fab4 P d09d9fb8020b43e18eb1dc003400cdd6: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260615 08:04:08.232594 4837 heartbeater.cc:499] Master 127.4.42.254:36069 was elected leader, sending a full tablet report...
I20260615 08:04:08.295987 5011 raft_consensus.cc:493] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260615 08:04:08.296067 5011 raft_consensus.cc:515] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d09d9fb8020b43e18eb1dc003400cdd6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 34597 } } peers { permanent_uuid: "f13ce792b555451eaf86624997475e9b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 34227 } } peers { permanent_uuid: "843e05afc19d44f997773e5988dd6fe8" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 34233 } }
I20260615 08:04:08.296289 5011 leader_election.cc:290] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d09d9fb8020b43e18eb1dc003400cdd6 (127.4.42.193:34597), f13ce792b555451eaf86624997475e9b (127.4.42.194:34227)
I20260615 08:04:08.299118 4811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259dcc77d81e45bda6f6874a27a3fab4" candidate_uuid: "843e05afc19d44f997773e5988dd6fe8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d09d9fb8020b43e18eb1dc003400cdd6" is_pre_election: true
I20260615 08:04:08.299204 4811 raft_consensus.cc:2468] T 259dcc77d81e45bda6f6874a27a3fab4 P d09d9fb8020b43e18eb1dc003400cdd6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 843e05afc19d44f997773e5988dd6fe8 in term 0.
I20260615 08:04:08.299211 4888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259dcc77d81e45bda6f6874a27a3fab4" candidate_uuid: "843e05afc19d44f997773e5988dd6fe8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f13ce792b555451eaf86624997475e9b" is_pre_election: true
I20260615 08:04:08.299330 4888 raft_consensus.cc:2468] T 259dcc77d81e45bda6f6874a27a3fab4 P f13ce792b555451eaf86624997475e9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 843e05afc19d44f997773e5988dd6fe8 in term 0.
I20260615 08:04:08.299365 4928 leader_election.cc:304] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 843e05afc19d44f997773e5988dd6fe8, d09d9fb8020b43e18eb1dc003400cdd6; no voters:
I20260615 08:04:08.299440 5011 raft_consensus.cc:2804] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260615 08:04:08.299476 5011 raft_consensus.cc:493] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:04:08.299508 5011 raft_consensus.cc:3060] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:04:08.300103 5011 raft_consensus.cc:515] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d09d9fb8020b43e18eb1dc003400cdd6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 34597 } } peers { permanent_uuid: "f13ce792b555451eaf86624997475e9b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 34227 } } peers { permanent_uuid: "843e05afc19d44f997773e5988dd6fe8" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 34233 } }
I20260615 08:04:08.300251 5011 leader_election.cc:290] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8 [CANDIDATE]: Term 1 election: Requested vote from peers d09d9fb8020b43e18eb1dc003400cdd6 (127.4.42.193:34597), f13ce792b555451eaf86624997475e9b (127.4.42.194:34227)
I20260615 08:04:08.300383 4811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259dcc77d81e45bda6f6874a27a3fab4" candidate_uuid: "843e05afc19d44f997773e5988dd6fe8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d09d9fb8020b43e18eb1dc003400cdd6"
I20260615 08:04:08.300448 4811 raft_consensus.cc:3060] T 259dcc77d81e45bda6f6874a27a3fab4 P d09d9fb8020b43e18eb1dc003400cdd6 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:04:08.300963 4811 raft_consensus.cc:2468] T 259dcc77d81e45bda6f6874a27a3fab4 P d09d9fb8020b43e18eb1dc003400cdd6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 843e05afc19d44f997773e5988dd6fe8 in term 1.
I20260615 08:04:08.301069 4888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259dcc77d81e45bda6f6874a27a3fab4" candidate_uuid: "843e05afc19d44f997773e5988dd6fe8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f13ce792b555451eaf86624997475e9b"
I20260615 08:04:08.301126 4888 raft_consensus.cc:3060] T 259dcc77d81e45bda6f6874a27a3fab4 P f13ce792b555451eaf86624997475e9b [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:04:08.301132 4928 leader_election.cc:304] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 843e05afc19d44f997773e5988dd6fe8, d09d9fb8020b43e18eb1dc003400cdd6; no voters:
I20260615 08:04:08.301275 5011 raft_consensus.cc:2804] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8 [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:04:08.301406 5011 raft_consensus.cc:697] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8 [term 1 LEADER]: Becoming Leader. State: Replica: 843e05afc19d44f997773e5988dd6fe8, State: Running, Role: LEADER
I20260615 08:04:08.301465 5011 consensus_queue.cc:237] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d09d9fb8020b43e18eb1dc003400cdd6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 34597 } } peers { permanent_uuid: "f13ce792b555451eaf86624997475e9b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 34227 } } peers { permanent_uuid: "843e05afc19d44f997773e5988dd6fe8" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 34233 } }
I20260615 08:04:08.301862 4888 raft_consensus.cc:2468] T 259dcc77d81e45bda6f6874a27a3fab4 P f13ce792b555451eaf86624997475e9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 843e05afc19d44f997773e5988dd6fe8 in term 1.
I20260615 08:04:08.302237 4707 catalog_manager.cc:5696] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 843e05afc19d44f997773e5988dd6fe8 (127.4.42.195). New cstate: current_term: 1 leader_uuid: "843e05afc19d44f997773e5988dd6fe8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d09d9fb8020b43e18eb1dc003400cdd6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 34597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f13ce792b555451eaf86624997475e9b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "843e05afc19d44f997773e5988dd6fe8" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 34233 } health_report { overall_health: HEALTHY } } }
I20260615 08:04:08.327613 4811 raft_consensus.cc:1275] T 259dcc77d81e45bda6f6874a27a3fab4 P d09d9fb8020b43e18eb1dc003400cdd6 [term 1 FOLLOWER]: Refusing update from remote peer 843e05afc19d44f997773e5988dd6fe8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:04:08.327628 4888 raft_consensus.cc:1275] T 259dcc77d81e45bda6f6874a27a3fab4 P f13ce792b555451eaf86624997475e9b [term 1 FOLLOWER]: Refusing update from remote peer 843e05afc19d44f997773e5988dd6fe8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:04:08.327857 5014 consensus_queue.cc:1048] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d09d9fb8020b43e18eb1dc003400cdd6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 34597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:04:08.327945 5011 consensus_queue.cc:1048] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f13ce792b555451eaf86624997475e9b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:04:18.929436 5011 raft_consensus.cc:993] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8: : Instructing follower d09d9fb8020b43e18eb1dc003400cdd6 to start an election
I20260615 08:04:18.929515 5011 raft_consensus.cc:1081] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8 [term 1 LEADER]: Signalling peer d09d9fb8020b43e18eb1dc003400cdd6 to start an election
I20260615 08:04:18.929729 4811 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "259dcc77d81e45bda6f6874a27a3fab4"
dest_uuid: "d09d9fb8020b43e18eb1dc003400cdd6"
from {username='slave'} at 127.0.0.1:60824
I20260615 08:04:18.929811 4811 raft_consensus.cc:493] T 259dcc77d81e45bda6f6874a27a3fab4 P d09d9fb8020b43e18eb1dc003400cdd6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260615 08:04:18.929833 4811 raft_consensus.cc:3060] T 259dcc77d81e45bda6f6874a27a3fab4 P d09d9fb8020b43e18eb1dc003400cdd6 [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:04:18.930516 4811 raft_consensus.cc:515] T 259dcc77d81e45bda6f6874a27a3fab4 P d09d9fb8020b43e18eb1dc003400cdd6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d09d9fb8020b43e18eb1dc003400cdd6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 34597 } } peers { permanent_uuid: "f13ce792b555451eaf86624997475e9b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 34227 } } peers { permanent_uuid: "843e05afc19d44f997773e5988dd6fe8" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 34233 } }
I20260615 08:04:18.930711 4811 leader_election.cc:290] T 259dcc77d81e45bda6f6874a27a3fab4 P d09d9fb8020b43e18eb1dc003400cdd6 [CANDIDATE]: Term 2 election: Requested vote from peers f13ce792b555451eaf86624997475e9b (127.4.42.194:34227), 843e05afc19d44f997773e5988dd6fe8 (127.4.42.195:34233)
I20260615 08:04:18.933405 4963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259dcc77d81e45bda6f6874a27a3fab4" candidate_uuid: "d09d9fb8020b43e18eb1dc003400cdd6" candidate_term: 2 candidate_status { last_received { term: 1 index: 13487 } } ignore_live_leader: true dest_uuid: "843e05afc19d44f997773e5988dd6fe8"
I20260615 08:04:18.933468 4963 raft_consensus.cc:3055] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8 [term 1 LEADER]: Stepping down as leader of term 1
I20260615 08:04:18.933486 4963 raft_consensus.cc:740] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 843e05afc19d44f997773e5988dd6fe8, State: Running, Role: LEADER
I20260615 08:04:18.933554 4963 consensus_queue.cc:260] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13487, Committed index: 13487, Last appended: 1.13487, Last appended by leader: 13487, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d09d9fb8020b43e18eb1dc003400cdd6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 34597 } } peers { permanent_uuid: "f13ce792b555451eaf86624997475e9b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 34227 } } peers { permanent_uuid: "843e05afc19d44f997773e5988dd6fe8" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 34233 } }
I20260615 08:04:18.933642 4963 raft_consensus.cc:3060] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8 [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:04:18.934156 4963 raft_consensus.cc:2468] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d09d9fb8020b43e18eb1dc003400cdd6 in term 2.
I20260615 08:04:18.934273 4888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259dcc77d81e45bda6f6874a27a3fab4" candidate_uuid: "d09d9fb8020b43e18eb1dc003400cdd6" candidate_term: 2 candidate_status { last_received { term: 1 index: 13487 } } ignore_live_leader: true dest_uuid: "f13ce792b555451eaf86624997475e9b"
I20260615 08:04:18.934334 4888 raft_consensus.cc:3060] T 259dcc77d81e45bda6f6874a27a3fab4 P f13ce792b555451eaf86624997475e9b [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:04:18.934337 4776 leader_election.cc:304] T 259dcc77d81e45bda6f6874a27a3fab4 P d09d9fb8020b43e18eb1dc003400cdd6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 843e05afc19d44f997773e5988dd6fe8, d09d9fb8020b43e18eb1dc003400cdd6; no voters:
I20260615 08:04:18.934648 5065 raft_consensus.cc:2804] T 259dcc77d81e45bda6f6874a27a3fab4 P d09d9fb8020b43e18eb1dc003400cdd6 [term 2 FOLLOWER]: Leader election won for term 2
I20260615 08:04:18.934792 5065 raft_consensus.cc:697] T 259dcc77d81e45bda6f6874a27a3fab4 P d09d9fb8020b43e18eb1dc003400cdd6 [term 2 LEADER]: Becoming Leader. State: Replica: d09d9fb8020b43e18eb1dc003400cdd6, State: Running, Role: LEADER
I20260615 08:04:18.934852 5065 consensus_queue.cc:237] T 259dcc77d81e45bda6f6874a27a3fab4 P d09d9fb8020b43e18eb1dc003400cdd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13487, Committed index: 13487, Last appended: 1.13487, Last appended by leader: 13487, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d09d9fb8020b43e18eb1dc003400cdd6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 34597 } } peers { permanent_uuid: "f13ce792b555451eaf86624997475e9b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 34227 } } peers { permanent_uuid: "843e05afc19d44f997773e5988dd6fe8" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 34233 } }
I20260615 08:04:18.935214 4888 raft_consensus.cc:2468] T 259dcc77d81e45bda6f6874a27a3fab4 P f13ce792b555451eaf86624997475e9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d09d9fb8020b43e18eb1dc003400cdd6 in term 2.
I20260615 08:04:18.935353 4705 catalog_manager.cc:5696] T 259dcc77d81e45bda6f6874a27a3fab4 P d09d9fb8020b43e18eb1dc003400cdd6 reported cstate change: term changed from 1 to 2, leader changed from 843e05afc19d44f997773e5988dd6fe8 (127.4.42.195) to d09d9fb8020b43e18eb1dc003400cdd6 (127.4.42.193). New cstate: current_term: 2 leader_uuid: "d09d9fb8020b43e18eb1dc003400cdd6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d09d9fb8020b43e18eb1dc003400cdd6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 34597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f13ce792b555451eaf86624997475e9b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 34227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "843e05afc19d44f997773e5988dd6fe8" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 34233 } health_report { overall_health: UNKNOWN } } }
I20260615 08:04:18.944060 4888 raft_consensus.cc:1275] T 259dcc77d81e45bda6f6874a27a3fab4 P f13ce792b555451eaf86624997475e9b [term 2 FOLLOWER]: Refusing update from remote peer d09d9fb8020b43e18eb1dc003400cdd6: Log matching property violated. Preceding OpId in replica: term: 1 index: 13487. Preceding OpId from leader: term: 2 index: 13489. (index mismatch)
I20260615 08:04:18.944098 4963 raft_consensus.cc:1275] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8 [term 2 FOLLOWER]: Refusing update from remote peer d09d9fb8020b43e18eb1dc003400cdd6: Log matching property violated. Preceding OpId in replica: term: 1 index: 13487. Preceding OpId from leader: term: 2 index: 13489. (index mismatch)
I20260615 08:04:18.944276 5066 consensus_queue.cc:1048] T 259dcc77d81e45bda6f6874a27a3fab4 P d09d9fb8020b43e18eb1dc003400cdd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f13ce792b555451eaf86624997475e9b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 34227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13488, Last known committed idx: 13487, Time since last communication: 0.000s
I20260615 08:04:18.944361 5065 consensus_queue.cc:1048] T 259dcc77d81e45bda6f6874a27a3fab4 P d09d9fb8020b43e18eb1dc003400cdd6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "843e05afc19d44f997773e5988dd6fe8" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 34233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13488, Last known committed idx: 13487, Time since last communication: 0.000s
I20260615 08:04:20.998214 4267 tablet_server.cc:179] TabletServer@127.4.42.193:0 shutting down...
I20260615 08:04:21.000662 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:04:21.000792 4267 tablet_replica.cc:333] T 259dcc77d81e45bda6f6874a27a3fab4 P d09d9fb8020b43e18eb1dc003400cdd6: stopping tablet replica
I20260615 08:04:21.000877 4267 raft_consensus.cc:2243] T 259dcc77d81e45bda6f6874a27a3fab4 P d09d9fb8020b43e18eb1dc003400cdd6 [term 2 LEADER]: Raft consensus shutting down.
I20260615 08:04:21.000937 4267 raft_consensus.cc:2272] T 259dcc77d81e45bda6f6874a27a3fab4 P d09d9fb8020b43e18eb1dc003400cdd6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:04:21.015101 4267 tablet_server.cc:196] TabletServer@127.4.42.193:0 shutdown complete.
I20260615 08:04:21.015908 4267 tablet_server.cc:179] TabletServer@127.4.42.194:0 shutting down...
I20260615 08:04:21.018545 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:04:21.018664 4267 tablet_replica.cc:333] T 259dcc77d81e45bda6f6874a27a3fab4 P f13ce792b555451eaf86624997475e9b: stopping tablet replica
I20260615 08:04:21.018721 4267 raft_consensus.cc:2243] T 259dcc77d81e45bda6f6874a27a3fab4 P f13ce792b555451eaf86624997475e9b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260615 08:04:21.018770 4267 raft_consensus.cc:2272] T 259dcc77d81e45bda6f6874a27a3fab4 P f13ce792b555451eaf86624997475e9b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:04:21.032228 4267 tablet_server.cc:196] TabletServer@127.4.42.194:0 shutdown complete.
I20260615 08:04:21.033150 4267 tablet_server.cc:179] TabletServer@127.4.42.195:0 shutting down...
I20260615 08:04:21.037995 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:04:21.038115 4267 tablet_replica.cc:333] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8: stopping tablet replica
I20260615 08:04:21.038183 4267 raft_consensus.cc:2243] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260615 08:04:21.038228 4267 raft_consensus.cc:2272] T 259dcc77d81e45bda6f6874a27a3fab4 P 843e05afc19d44f997773e5988dd6fe8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:04:21.061375 4267 tablet_server.cc:196] TabletServer@127.4.42.195:0 shutdown complete.
I20260615 08:04:21.062196 4267 master.cc:562] Master@127.4.42.254:36069 shutting down...
I20260615 08:04:21.064383 4267 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c7d4e743f05b4d18a8594a44188ec867 [term 1 LEADER]: Raft consensus shutting down.
I20260615 08:04:21.064445 4267 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c7d4e743f05b4d18a8594a44188ec867 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:04:21.064462 4267 tablet_replica.cc:333] T 00000000000000000000000000000000 P c7d4e743f05b4d18a8594a44188ec867: stopping tablet replica
I20260615 08:04:21.075911 4267 master.cc:584] Master@127.4.42.254:36069 shutdown complete.
[ OK ] TxnParticipantITest.TestWaitOnFinalizeCommit (13004 ms)
[ RUN ] TxnParticipantITest.TestWaitOnAbortCommit
I20260615 08:04:21.094352 4267 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.42.254:42869
I20260615 08:04:21.094651 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260615 08:04:21.096268 4267 server_base.cc:1061] running on GCE node
W20260615 08:04:21.096336 5107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:04:21.096330 5108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:04:21.096386 5110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:04:21.096581 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:04:21.096628 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:04:21.096642 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510661096642 us; error 0 us; skew 500 ppm
I20260615 08:04:21.097177 4267 webserver.cc:533] Webserver started at http://127.4.42.254:38321/ using document root <none> and password file <none>
I20260615 08:04:21.097241 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:04:21.097267 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:04:21.097301 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:04:21.097519 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1781510637089012-4267-0/minicluster-data/master-0-root/instance:
uuid: "1860397ba7e04f6c95019e71c41276a7"
format_stamp: "Formatted at 2026-06-15 08:04:21 on dist-test-slave-37n8"
I20260615 08:04:21.098352 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:04:21.098865 5115 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:21.098985 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:21.099035 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1781510637089012-4267-0/minicluster-data/master-0-root
uuid: "1860397ba7e04f6c95019e71c41276a7"
format_stamp: "Formatted at 2026-06-15 08:04:21 on dist-test-slave-37n8"
I20260615 08:04:21.099080 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1781510637089012-4267-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1781510637089012-4267-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1781510637089012-4267-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:04:21.103683 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:04:21.103822 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:04:21.106091 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.254:42869
I20260615 08:04:21.115083 5167 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.254:42869 every 8 connection(s)
I20260615 08:04:21.115202 5168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:04:21.116133 5168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1860397ba7e04f6c95019e71c41276a7: Bootstrap starting.
I20260615 08:04:21.116477 5168 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1860397ba7e04f6c95019e71c41276a7: Neither blocks nor log segments found. Creating new log.
I20260615 08:04:21.116966 5168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1860397ba7e04f6c95019e71c41276a7: No bootstrap required, opened a new log
I20260615 08:04:21.117107 5168 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1860397ba7e04f6c95019e71c41276a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1860397ba7e04f6c95019e71c41276a7" member_type: VOTER }
I20260615 08:04:21.117165 5168 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1860397ba7e04f6c95019e71c41276a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:04:21.117228 5168 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1860397ba7e04f6c95019e71c41276a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1860397ba7e04f6c95019e71c41276a7, State: Initialized, Role: FOLLOWER
I20260615 08:04:21.117280 5168 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1860397ba7e04f6c95019e71c41276a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1860397ba7e04f6c95019e71c41276a7" member_type: VOTER }
I20260615 08:04:21.117317 5168 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1860397ba7e04f6c95019e71c41276a7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260615 08:04:21.117347 5168 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1860397ba7e04f6c95019e71c41276a7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260615 08:04:21.117375 5168 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1860397ba7e04f6c95019e71c41276a7 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:04:21.117846 5168 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1860397ba7e04f6c95019e71c41276a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1860397ba7e04f6c95019e71c41276a7" member_type: VOTER }
I20260615 08:04:21.117902 5168 leader_election.cc:304] T 00000000000000000000000000000000 P 1860397ba7e04f6c95019e71c41276a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1860397ba7e04f6c95019e71c41276a7; no voters:
I20260615 08:04:21.118019 5168 leader_election.cc:290] T 00000000000000000000000000000000 P 1860397ba7e04f6c95019e71c41276a7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260615 08:04:21.118091 5171 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1860397ba7e04f6c95019e71c41276a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:04:21.118191 5168 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1860397ba7e04f6c95019e71c41276a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260615 08:04:21.118225 5171 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1860397ba7e04f6c95019e71c41276a7 [term 1 LEADER]: Becoming Leader. State: Replica: 1860397ba7e04f6c95019e71c41276a7, State: Running, Role: LEADER
I20260615 08:04:21.118300 5171 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1860397ba7e04f6c95019e71c41276a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1860397ba7e04f6c95019e71c41276a7" member_type: VOTER }
I20260615 08:04:21.118517 5172 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1860397ba7e04f6c95019e71c41276a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1860397ba7e04f6c95019e71c41276a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1860397ba7e04f6c95019e71c41276a7" member_type: VOTER } }
I20260615 08:04:21.118520 5173 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1860397ba7e04f6c95019e71c41276a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1860397ba7e04f6c95019e71c41276a7. Latest consensus state: current_term: 1 leader_uuid: "1860397ba7e04f6c95019e71c41276a7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1860397ba7e04f6c95019e71c41276a7" member_type: VOTER } }
I20260615 08:04:21.118695 5172 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1860397ba7e04f6c95019e71c41276a7 [sys.catalog]: This master's current role is: LEADER
I20260615 08:04:21.118736 5173 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1860397ba7e04f6c95019e71c41276a7 [sys.catalog]: This master's current role is: LEADER
I20260615 08:04:21.119010 5177 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260615 08:04:21.119177 5177 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260615 08:04:21.119654 4267 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260615 08:04:21.119695 5177 catalog_manager.cc:1382] Generated new cluster ID: 52d8b57250744d8295696e05e3f9f3d2
I20260615 08:04:21.119740 5177 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260615 08:04:21.142940 5177 catalog_manager.cc:1405] Generated new certificate authority record
I20260615 08:04:21.143397 5177 catalog_manager.cc:1539] Loading token signing keys...
I20260615 08:04:21.154532 5177 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 1860397ba7e04f6c95019e71c41276a7: Generated new TSK 0
I20260615 08:04:21.154659 5177 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260615 08:04:21.183761 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:04:21.185088 5192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:04:21.185096 5190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:04:21.185217 5189 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:04:21.185220 4267 server_base.cc:1061] running on GCE node
I20260615 08:04:21.185376 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:04:21.185427 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:04:21.185449 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510661185449 us; error 0 us; skew 500 ppm
I20260615 08:04:21.185940 4267 webserver.cc:533] Webserver started at http://127.4.42.193:39711/ using document root <none> and password file <none>
I20260615 08:04:21.186036 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:04:21.186103 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:04:21.186170 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:04:21.186419 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1781510637089012-4267-0/minicluster-data/ts-0-root/instance:
uuid: "2639c802cf3141808cd755bbf20012b5"
format_stamp: "Formatted at 2026-06-15 08:04:21 on dist-test-slave-37n8"
I20260615 08:04:21.187290 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:04:21.187743 5197 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:21.187881 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:21.187939 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1781510637089012-4267-0/minicluster-data/ts-0-root
uuid: "2639c802cf3141808cd755bbf20012b5"
format_stamp: "Formatted at 2026-06-15 08:04:21 on dist-test-slave-37n8"
I20260615 08:04:21.188010 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1781510637089012-4267-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1781510637089012-4267-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1781510637089012-4267-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:04:21.196969 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:04:21.197161 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:04:21.197315 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:04:21.197492 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:04:21.197535 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:21.197571 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:04:21.197597 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:21.200536 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.193:37429
I20260615 08:04:21.200565 5260 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.193:37429 every 8 connection(s)
I20260615 08:04:21.200909 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:04:21.201860 5265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:04:21.201951 5266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:04:21.201956 5268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:04:21.202239 4267 server_base.cc:1061] running on GCE node
I20260615 08:04:21.202373 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:04:21.202437 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:04:21.202456 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510661202457 us; error 0 us; skew 500 ppm
I20260615 08:04:21.202999 4267 webserver.cc:533] Webserver started at http://127.4.42.194:44139/ using document root <none> and password file <none>
I20260615 08:04:21.203095 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:04:21.203142 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:04:21.203187 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:04:21.203419 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1781510637089012-4267-0/minicluster-data/ts-1-root/instance:
uuid: "41d6cad985f54cfc97fbe5e05a28184e"
format_stamp: "Formatted at 2026-06-15 08:04:21 on dist-test-slave-37n8"
I20260615 08:04:21.204445 5261 heartbeater.cc:344] Connected to a master server at 127.4.42.254:42869
I20260615 08:04:21.204510 5261 heartbeater.cc:461] Registering TS with master...
I20260615 08:04:21.204568 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:04:21.204607 5261 heartbeater.cc:507] Master 127.4.42.254:42869 requested a full tablet report, sending...
I20260615 08:04:21.204845 5132 ts_manager.cc:194] Registered new tserver with Master: 2639c802cf3141808cd755bbf20012b5 (127.4.42.193:37429)
I20260615 08:04:21.205138 5273 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:21.205283 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:21.205350 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1781510637089012-4267-0/minicluster-data/ts-1-root
uuid: "41d6cad985f54cfc97fbe5e05a28184e"
format_stamp: "Formatted at 2026-06-15 08:04:21 on dist-test-slave-37n8"
I20260615 08:04:21.205397 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1781510637089012-4267-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1781510637089012-4267-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1781510637089012-4267-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:04:21.205642 5132 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55168
I20260615 08:04:21.220335 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:04:21.220530 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:04:21.220672 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:04:21.220852 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:04:21.220896 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:21.220932 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:04:21.220969 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:21.223868 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.194:33733
I20260615 08:04:21.223925 5336 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.194:33733 every 8 connection(s)
I20260615 08:04:21.224252 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:04:21.225332 5341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:04:21.225472 5343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:04:21.225603 4267 server_base.cc:1061] running on GCE node
W20260615 08:04:21.225317 5340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:04:21.226006 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:04:21.226052 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:04:21.226071 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510661226071 us; error 0 us; skew 500 ppm
I20260615 08:04:21.226646 4267 webserver.cc:533] Webserver started at http://127.4.42.195:39699/ using document root <none> and password file <none>
I20260615 08:04:21.226743 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:04:21.226786 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:04:21.226831 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:04:21.227099 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1781510637089012-4267-0/minicluster-data/ts-2-root/instance:
uuid: "c95ce4ff5c5f481daf46b4d9e2cbd9fe"
format_stamp: "Formatted at 2026-06-15 08:04:21 on dist-test-slave-37n8"
I20260615 08:04:21.227356 5337 heartbeater.cc:344] Connected to a master server at 127.4.42.254:42869
I20260615 08:04:21.227423 5337 heartbeater.cc:461] Registering TS with master...
I20260615 08:04:21.227521 5337 heartbeater.cc:507] Master 127.4.42.254:42869 requested a full tablet report, sending...
I20260615 08:04:21.227739 5132 ts_manager.cc:194] Registered new tserver with Master: 41d6cad985f54cfc97fbe5e05a28184e (127.4.42.194:33733)
I20260615 08:04:21.228025 5132 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55182
I20260615 08:04:21.228231 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:04:21.228680 5348 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:21.228814 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:21.228866 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1781510637089012-4267-0/minicluster-data/ts-2-root
uuid: "c95ce4ff5c5f481daf46b4d9e2cbd9fe"
format_stamp: "Formatted at 2026-06-15 08:04:21 on dist-test-slave-37n8"
I20260615 08:04:21.228919 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1781510637089012-4267-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1781510637089012-4267-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestWaitOnAbortCommit.1781510637089012-4267-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:04:21.246037 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:04:21.246258 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:04:21.246431 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:04:21.246622 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:04:21.246668 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:21.246693 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:04:21.246721 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:21.249684 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.195:39095
I20260615 08:04:21.249740 5411 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.195:39095 every 8 connection(s)
I20260615 08:04:21.252552 5412 heartbeater.cc:344] Connected to a master server at 127.4.42.254:42869
I20260615 08:04:21.252597 5412 heartbeater.cc:461] Registering TS with master...
I20260615 08:04:21.252665 5412 heartbeater.cc:507] Master 127.4.42.254:42869 requested a full tablet report, sending...
I20260615 08:04:21.252861 5132 ts_manager.cc:194] Registered new tserver with Master: c95ce4ff5c5f481daf46b4d9e2cbd9fe (127.4.42.195:39095)
I20260615 08:04:21.253119 5132 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55192
I20260615 08:04:21.253142 4267 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003305384s
I20260615 08:04:21.257827 5132 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55202:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260615 08:04:21.257941 5132 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260615 08:04:21.262785 5225 tablet_service.cc:1511] Processing CreateTablet for tablet 941cc916320d4f07822ed6cdc4fdc450 (DEFAULT_TABLE table=test-workload [id=6ec237c25b56481685ca9413f3db0bc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:04:21.262856 5376 tablet_service.cc:1511] Processing CreateTablet for tablet 941cc916320d4f07822ed6cdc4fdc450 (DEFAULT_TABLE table=test-workload [id=6ec237c25b56481685ca9413f3db0bc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:04:21.262902 5225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 941cc916320d4f07822ed6cdc4fdc450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:04:21.262971 5376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 941cc916320d4f07822ed6cdc4fdc450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:04:21.264020 5427 tablet_bootstrap.cc:492] T 941cc916320d4f07822ed6cdc4fdc450 P 2639c802cf3141808cd755bbf20012b5: Bootstrap starting.
I20260615 08:04:21.264117 5301 tablet_service.cc:1511] Processing CreateTablet for tablet 941cc916320d4f07822ed6cdc4fdc450 (DEFAULT_TABLE table=test-workload [id=6ec237c25b56481685ca9413f3db0bc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:04:21.264209 5428 tablet_bootstrap.cc:492] T 941cc916320d4f07822ed6cdc4fdc450 P c95ce4ff5c5f481daf46b4d9e2cbd9fe: Bootstrap starting.
I20260615 08:04:21.264235 5301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 941cc916320d4f07822ed6cdc4fdc450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:04:21.264556 5427 tablet_bootstrap.cc:654] T 941cc916320d4f07822ed6cdc4fdc450 P 2639c802cf3141808cd755bbf20012b5: Neither blocks nor log segments found. Creating new log.
I20260615 08:04:21.264638 5428 tablet_bootstrap.cc:654] T 941cc916320d4f07822ed6cdc4fdc450 P c95ce4ff5c5f481daf46b4d9e2cbd9fe: Neither blocks nor log segments found. Creating new log.
I20260615 08:04:21.265312 5427 tablet_bootstrap.cc:492] T 941cc916320d4f07822ed6cdc4fdc450 P 2639c802cf3141808cd755bbf20012b5: No bootstrap required, opened a new log
I20260615 08:04:21.265363 5427 ts_tablet_manager.cc:1403] T 941cc916320d4f07822ed6cdc4fdc450 P 2639c802cf3141808cd755bbf20012b5: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:04:21.265497 5431 tablet_bootstrap.cc:492] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e: Bootstrap starting.
I20260615 08:04:21.265516 5427 raft_consensus.cc:359] T 941cc916320d4f07822ed6cdc4fdc450 P 2639c802cf3141808cd755bbf20012b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ce4ff5c5f481daf46b4d9e2cbd9fe" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39095 } } peers { permanent_uuid: "41d6cad985f54cfc97fbe5e05a28184e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 33733 } } peers { permanent_uuid: "2639c802cf3141808cd755bbf20012b5" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 37429 } }
I20260615 08:04:21.265579 5427 raft_consensus.cc:385] T 941cc916320d4f07822ed6cdc4fdc450 P 2639c802cf3141808cd755bbf20012b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:04:21.265607 5427 raft_consensus.cc:740] T 941cc916320d4f07822ed6cdc4fdc450 P 2639c802cf3141808cd755bbf20012b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2639c802cf3141808cd755bbf20012b5, State: Initialized, Role: FOLLOWER
I20260615 08:04:21.265667 5427 consensus_queue.cc:260] T 941cc916320d4f07822ed6cdc4fdc450 P 2639c802cf3141808cd755bbf20012b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ce4ff5c5f481daf46b4d9e2cbd9fe" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39095 } } peers { permanent_uuid: "41d6cad985f54cfc97fbe5e05a28184e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 33733 } } peers { permanent_uuid: "2639c802cf3141808cd755bbf20012b5" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 37429 } }
I20260615 08:04:21.265838 5427 ts_tablet_manager.cc:1434] T 941cc916320d4f07822ed6cdc4fdc450 P 2639c802cf3141808cd755bbf20012b5: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260615 08:04:21.265861 5261 heartbeater.cc:499] Master 127.4.42.254:42869 was elected leader, sending a full tablet report...
I20260615 08:04:21.265938 5431 tablet_bootstrap.cc:654] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e: Neither blocks nor log segments found. Creating new log.
I20260615 08:04:21.266036 5428 tablet_bootstrap.cc:492] T 941cc916320d4f07822ed6cdc4fdc450 P c95ce4ff5c5f481daf46b4d9e2cbd9fe: No bootstrap required, opened a new log
I20260615 08:04:21.266088 5428 ts_tablet_manager.cc:1403] T 941cc916320d4f07822ed6cdc4fdc450 P c95ce4ff5c5f481daf46b4d9e2cbd9fe: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260615 08:04:21.266245 5428 raft_consensus.cc:359] T 941cc916320d4f07822ed6cdc4fdc450 P c95ce4ff5c5f481daf46b4d9e2cbd9fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ce4ff5c5f481daf46b4d9e2cbd9fe" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39095 } } peers { permanent_uuid: "41d6cad985f54cfc97fbe5e05a28184e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 33733 } } peers { permanent_uuid: "2639c802cf3141808cd755bbf20012b5" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 37429 } }
I20260615 08:04:21.266316 5428 raft_consensus.cc:385] T 941cc916320d4f07822ed6cdc4fdc450 P c95ce4ff5c5f481daf46b4d9e2cbd9fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:04:21.266338 5428 raft_consensus.cc:740] T 941cc916320d4f07822ed6cdc4fdc450 P c95ce4ff5c5f481daf46b4d9e2cbd9fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95ce4ff5c5f481daf46b4d9e2cbd9fe, State: Initialized, Role: FOLLOWER
I20260615 08:04:21.266400 5428 consensus_queue.cc:260] T 941cc916320d4f07822ed6cdc4fdc450 P c95ce4ff5c5f481daf46b4d9e2cbd9fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ce4ff5c5f481daf46b4d9e2cbd9fe" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39095 } } peers { permanent_uuid: "41d6cad985f54cfc97fbe5e05a28184e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 33733 } } peers { permanent_uuid: "2639c802cf3141808cd755bbf20012b5" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 37429 } }
I20260615 08:04:21.266583 5428 ts_tablet_manager.cc:1434] T 941cc916320d4f07822ed6cdc4fdc450 P c95ce4ff5c5f481daf46b4d9e2cbd9fe: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260615 08:04:21.266610 5412 heartbeater.cc:499] Master 127.4.42.254:42869 was elected leader, sending a full tablet report...
I20260615 08:04:21.266644 5431 tablet_bootstrap.cc:492] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e: No bootstrap required, opened a new log
I20260615 08:04:21.266690 5431 ts_tablet_manager.cc:1403] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:04:21.266822 5431 raft_consensus.cc:359] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ce4ff5c5f481daf46b4d9e2cbd9fe" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39095 } } peers { permanent_uuid: "41d6cad985f54cfc97fbe5e05a28184e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 33733 } } peers { permanent_uuid: "2639c802cf3141808cd755bbf20012b5" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 37429 } }
I20260615 08:04:21.266873 5431 raft_consensus.cc:385] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:04:21.266886 5431 raft_consensus.cc:740] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41d6cad985f54cfc97fbe5e05a28184e, State: Initialized, Role: FOLLOWER
I20260615 08:04:21.266939 5431 consensus_queue.cc:260] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ce4ff5c5f481daf46b4d9e2cbd9fe" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39095 } } peers { permanent_uuid: "41d6cad985f54cfc97fbe5e05a28184e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 33733 } } peers { permanent_uuid: "2639c802cf3141808cd755bbf20012b5" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 37429 } }
I20260615 08:04:21.267102 5431 ts_tablet_manager.cc:1434] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260615 08:04:21.267110 5337 heartbeater.cc:499] Master 127.4.42.254:42869 was elected leader, sending a full tablet report...
I20260615 08:04:21.450557 5435 raft_consensus.cc:493] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260615 08:04:21.450696 5435 raft_consensus.cc:515] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ce4ff5c5f481daf46b4d9e2cbd9fe" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39095 } } peers { permanent_uuid: "41d6cad985f54cfc97fbe5e05a28184e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 33733 } } peers { permanent_uuid: "2639c802cf3141808cd755bbf20012b5" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 37429 } }
I20260615 08:04:21.450949 5435 leader_election.cc:290] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c95ce4ff5c5f481daf46b4d9e2cbd9fe (127.4.42.195:39095), 2639c802cf3141808cd755bbf20012b5 (127.4.42.193:37429)
I20260615 08:04:21.454411 5235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941cc916320d4f07822ed6cdc4fdc450" candidate_uuid: "41d6cad985f54cfc97fbe5e05a28184e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2639c802cf3141808cd755bbf20012b5" is_pre_election: true
I20260615 08:04:21.454416 5386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941cc916320d4f07822ed6cdc4fdc450" candidate_uuid: "41d6cad985f54cfc97fbe5e05a28184e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95ce4ff5c5f481daf46b4d9e2cbd9fe" is_pre_election: true
I20260615 08:04:21.454555 5235 raft_consensus.cc:2468] T 941cc916320d4f07822ed6cdc4fdc450 P 2639c802cf3141808cd755bbf20012b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41d6cad985f54cfc97fbe5e05a28184e in term 0.
I20260615 08:04:21.454576 5386 raft_consensus.cc:2468] T 941cc916320d4f07822ed6cdc4fdc450 P c95ce4ff5c5f481daf46b4d9e2cbd9fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41d6cad985f54cfc97fbe5e05a28184e in term 0.
I20260615 08:04:21.454787 5274 leader_election.cc:304] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2639c802cf3141808cd755bbf20012b5, 41d6cad985f54cfc97fbe5e05a28184e; no voters:
I20260615 08:04:21.454905 5435 raft_consensus.cc:2804] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260615 08:04:21.454942 5435 raft_consensus.cc:493] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:04:21.454970 5435 raft_consensus.cc:3060] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:04:21.455614 5435 raft_consensus.cc:515] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ce4ff5c5f481daf46b4d9e2cbd9fe" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39095 } } peers { permanent_uuid: "41d6cad985f54cfc97fbe5e05a28184e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 33733 } } peers { permanent_uuid: "2639c802cf3141808cd755bbf20012b5" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 37429 } }
I20260615 08:04:21.455763 5435 leader_election.cc:290] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e [CANDIDATE]: Term 1 election: Requested vote from peers c95ce4ff5c5f481daf46b4d9e2cbd9fe (127.4.42.195:39095), 2639c802cf3141808cd755bbf20012b5 (127.4.42.193:37429)
I20260615 08:04:21.455921 5235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941cc916320d4f07822ed6cdc4fdc450" candidate_uuid: "41d6cad985f54cfc97fbe5e05a28184e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2639c802cf3141808cd755bbf20012b5"
I20260615 08:04:21.455991 5235 raft_consensus.cc:3060] T 941cc916320d4f07822ed6cdc4fdc450 P 2639c802cf3141808cd755bbf20012b5 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:04:21.456564 5235 raft_consensus.cc:2468] T 941cc916320d4f07822ed6cdc4fdc450 P 2639c802cf3141808cd755bbf20012b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41d6cad985f54cfc97fbe5e05a28184e in term 1.
I20260615 08:04:21.456673 5386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941cc916320d4f07822ed6cdc4fdc450" candidate_uuid: "41d6cad985f54cfc97fbe5e05a28184e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95ce4ff5c5f481daf46b4d9e2cbd9fe"
I20260615 08:04:21.456713 5274 leader_election.cc:304] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2639c802cf3141808cd755bbf20012b5, 41d6cad985f54cfc97fbe5e05a28184e; no voters:
I20260615 08:04:21.456733 5386 raft_consensus.cc:3060] T 941cc916320d4f07822ed6cdc4fdc450 P c95ce4ff5c5f481daf46b4d9e2cbd9fe [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:04:21.456837 5435 raft_consensus.cc:2804] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:04:21.456997 5435 raft_consensus.cc:697] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e [term 1 LEADER]: Becoming Leader. State: Replica: 41d6cad985f54cfc97fbe5e05a28184e, State: Running, Role: LEADER
I20260615 08:04:21.457047 5435 consensus_queue.cc:237] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ce4ff5c5f481daf46b4d9e2cbd9fe" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39095 } } peers { permanent_uuid: "41d6cad985f54cfc97fbe5e05a28184e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 33733 } } peers { permanent_uuid: "2639c802cf3141808cd755bbf20012b5" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 37429 } }
I20260615 08:04:21.457527 5386 raft_consensus.cc:2468] T 941cc916320d4f07822ed6cdc4fdc450 P c95ce4ff5c5f481daf46b4d9e2cbd9fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41d6cad985f54cfc97fbe5e05a28184e in term 1.
I20260615 08:04:21.457906 5132 catalog_manager.cc:5696] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e reported cstate change: term changed from 0 to 1, leader changed from <none> to 41d6cad985f54cfc97fbe5e05a28184e (127.4.42.194). New cstate: current_term: 1 leader_uuid: "41d6cad985f54cfc97fbe5e05a28184e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ce4ff5c5f481daf46b4d9e2cbd9fe" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41d6cad985f54cfc97fbe5e05a28184e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 33733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2639c802cf3141808cd755bbf20012b5" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 37429 } health_report { overall_health: UNKNOWN } } }
I20260615 08:04:21.492249 5235 raft_consensus.cc:1275] T 941cc916320d4f07822ed6cdc4fdc450 P 2639c802cf3141808cd755bbf20012b5 [term 1 FOLLOWER]: Refusing update from remote peer 41d6cad985f54cfc97fbe5e05a28184e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:04:21.492249 5386 raft_consensus.cc:1275] T 941cc916320d4f07822ed6cdc4fdc450 P c95ce4ff5c5f481daf46b4d9e2cbd9fe [term 1 FOLLOWER]: Refusing update from remote peer 41d6cad985f54cfc97fbe5e05a28184e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:04:21.492511 5437 consensus_queue.cc:1048] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95ce4ff5c5f481daf46b4d9e2cbd9fe" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:04:21.492588 5435 consensus_queue.cc:1048] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2639c802cf3141808cd755bbf20012b5" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 37429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:04:21.495330 5446 mvcc.cc:204] Tried to move back new op lower bound from 7297067669470838784 to 7297067669328556032. Current Snapshot: MvccSnapshot[applied={T|T < 7297067669470838784 or (T in {7297067669470838784})}]
I20260615 08:04:31.982110 5437 raft_consensus.cc:993] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e: : Instructing follower 2639c802cf3141808cd755bbf20012b5 to start an election
I20260615 08:04:31.982218 5437 raft_consensus.cc:1081] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e [term 1 LEADER]: Signalling peer 2639c802cf3141808cd755bbf20012b5 to start an election
I20260615 08:04:31.982422 5235 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "941cc916320d4f07822ed6cdc4fdc450"
dest_uuid: "2639c802cf3141808cd755bbf20012b5"
from {username='slave'} at 127.0.0.1:43946
I20260615 08:04:31.982527 5235 raft_consensus.cc:493] T 941cc916320d4f07822ed6cdc4fdc450 P 2639c802cf3141808cd755bbf20012b5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260615 08:04:31.982558 5235 raft_consensus.cc:3060] T 941cc916320d4f07822ed6cdc4fdc450 P 2639c802cf3141808cd755bbf20012b5 [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:04:31.983197 5235 raft_consensus.cc:515] T 941cc916320d4f07822ed6cdc4fdc450 P 2639c802cf3141808cd755bbf20012b5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ce4ff5c5f481daf46b4d9e2cbd9fe" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39095 } } peers { permanent_uuid: "41d6cad985f54cfc97fbe5e05a28184e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 33733 } } peers { permanent_uuid: "2639c802cf3141808cd755bbf20012b5" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 37429 } }
I20260615 08:04:31.983372 5235 leader_election.cc:290] T 941cc916320d4f07822ed6cdc4fdc450 P 2639c802cf3141808cd755bbf20012b5 [CANDIDATE]: Term 2 election: Requested vote from peers c95ce4ff5c5f481daf46b4d9e2cbd9fe (127.4.42.195:39095), 41d6cad985f54cfc97fbe5e05a28184e (127.4.42.194:33733)
I20260615 08:04:31.986023 5311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941cc916320d4f07822ed6cdc4fdc450" candidate_uuid: "2639c802cf3141808cd755bbf20012b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 13701 } } ignore_live_leader: true dest_uuid: "41d6cad985f54cfc97fbe5e05a28184e"
I20260615 08:04:31.986088 5386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "941cc916320d4f07822ed6cdc4fdc450" candidate_uuid: "2639c802cf3141808cd755bbf20012b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 13701 } } ignore_live_leader: true dest_uuid: "c95ce4ff5c5f481daf46b4d9e2cbd9fe"
I20260615 08:04:31.986100 5311 raft_consensus.cc:3055] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e [term 1 LEADER]: Stepping down as leader of term 1
I20260615 08:04:31.986214 5386 raft_consensus.cc:3060] T 941cc916320d4f07822ed6cdc4fdc450 P c95ce4ff5c5f481daf46b4d9e2cbd9fe [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:04:31.986227 5311 raft_consensus.cc:740] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 41d6cad985f54cfc97fbe5e05a28184e, State: Running, Role: LEADER
I20260615 08:04:31.986297 5311 consensus_queue.cc:260] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13701, Committed index: 13701, Last appended: 1.13701, Last appended by leader: 13701, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ce4ff5c5f481daf46b4d9e2cbd9fe" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39095 } } peers { permanent_uuid: "41d6cad985f54cfc97fbe5e05a28184e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 33733 } } peers { permanent_uuid: "2639c802cf3141808cd755bbf20012b5" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 37429 } }
I20260615 08:04:31.986382 5311 raft_consensus.cc:3060] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:04:31.986907 5386 raft_consensus.cc:2468] T 941cc916320d4f07822ed6cdc4fdc450 P c95ce4ff5c5f481daf46b4d9e2cbd9fe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2639c802cf3141808cd755bbf20012b5 in term 2.
I20260615 08:04:31.987069 5199 leader_election.cc:304] T 941cc916320d4f07822ed6cdc4fdc450 P 2639c802cf3141808cd755bbf20012b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2639c802cf3141808cd755bbf20012b5, c95ce4ff5c5f481daf46b4d9e2cbd9fe; no voters:
I20260615 08:04:31.987069 5311 raft_consensus.cc:2468] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2639c802cf3141808cd755bbf20012b5 in term 2.
I20260615 08:04:31.987301 5485 raft_consensus.cc:2804] T 941cc916320d4f07822ed6cdc4fdc450 P 2639c802cf3141808cd755bbf20012b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260615 08:04:31.987416 5485 raft_consensus.cc:697] T 941cc916320d4f07822ed6cdc4fdc450 P 2639c802cf3141808cd755bbf20012b5 [term 2 LEADER]: Becoming Leader. State: Replica: 2639c802cf3141808cd755bbf20012b5, State: Running, Role: LEADER
I20260615 08:04:31.987465 5485 consensus_queue.cc:237] T 941cc916320d4f07822ed6cdc4fdc450 P 2639c802cf3141808cd755bbf20012b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13701, Committed index: 13701, Last appended: 1.13701, Last appended by leader: 13701, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ce4ff5c5f481daf46b4d9e2cbd9fe" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39095 } } peers { permanent_uuid: "41d6cad985f54cfc97fbe5e05a28184e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 33733 } } peers { permanent_uuid: "2639c802cf3141808cd755bbf20012b5" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 37429 } }
I20260615 08:04:31.987960 5132 catalog_manager.cc:5696] T 941cc916320d4f07822ed6cdc4fdc450 P 2639c802cf3141808cd755bbf20012b5 reported cstate change: term changed from 1 to 2, leader changed from 41d6cad985f54cfc97fbe5e05a28184e (127.4.42.194) to 2639c802cf3141808cd755bbf20012b5 (127.4.42.193). New cstate: current_term: 2 leader_uuid: "2639c802cf3141808cd755bbf20012b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95ce4ff5c5f481daf46b4d9e2cbd9fe" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41d6cad985f54cfc97fbe5e05a28184e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 33733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2639c802cf3141808cd755bbf20012b5" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 37429 } health_report { overall_health: HEALTHY } } }
I20260615 08:04:31.991458 5311 raft_consensus.cc:1275] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e [term 2 FOLLOWER]: Refusing update from remote peer 2639c802cf3141808cd755bbf20012b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 13701. Preceding OpId from leader: term: 2 index: 13703. (index mismatch)
I20260615 08:04:31.991503 5386 raft_consensus.cc:1275] T 941cc916320d4f07822ed6cdc4fdc450 P c95ce4ff5c5f481daf46b4d9e2cbd9fe [term 2 FOLLOWER]: Refusing update from remote peer 2639c802cf3141808cd755bbf20012b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 13701. Preceding OpId from leader: term: 2 index: 13703. (index mismatch)
I20260615 08:04:31.991717 5486 consensus_queue.cc:1048] T 941cc916320d4f07822ed6cdc4fdc450 P 2639c802cf3141808cd755bbf20012b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41d6cad985f54cfc97fbe5e05a28184e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 33733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13702, Last known committed idx: 13701, Time since last communication: 0.000s
I20260615 08:04:31.991820 5485 consensus_queue.cc:1048] T 941cc916320d4f07822ed6cdc4fdc450 P 2639c802cf3141808cd755bbf20012b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95ce4ff5c5f481daf46b4d9e2cbd9fe" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13702, Last known committed idx: 13701, Time since last communication: 0.000s
I20260615 08:04:33.024952 4267 tablet_server.cc:179] TabletServer@127.4.42.193:0 shutting down...
I20260615 08:04:33.027388 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:04:33.027508 4267 tablet_replica.cc:333] T 941cc916320d4f07822ed6cdc4fdc450 P 2639c802cf3141808cd755bbf20012b5: stopping tablet replica
I20260615 08:04:33.027566 4267 raft_consensus.cc:2243] T 941cc916320d4f07822ed6cdc4fdc450 P 2639c802cf3141808cd755bbf20012b5 [term 2 LEADER]: Raft consensus shutting down.
I20260615 08:04:33.027633 4267 raft_consensus.cc:2272] T 941cc916320d4f07822ed6cdc4fdc450 P 2639c802cf3141808cd755bbf20012b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:04:33.044158 4267 tablet_server.cc:196] TabletServer@127.4.42.193:0 shutdown complete.
I20260615 08:04:33.045032 4267 tablet_server.cc:179] TabletServer@127.4.42.194:0 shutting down...
I20260615 08:04:33.047695 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:04:33.047801 4267 tablet_replica.cc:333] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e: stopping tablet replica
I20260615 08:04:33.047856 4267 raft_consensus.cc:2243] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260615 08:04:33.047900 4267 raft_consensus.cc:2272] T 941cc916320d4f07822ed6cdc4fdc450 P 41d6cad985f54cfc97fbe5e05a28184e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:04:33.060930 4267 tablet_server.cc:196] TabletServer@127.4.42.194:0 shutdown complete.
I20260615 08:04:33.061650 4267 tablet_server.cc:179] TabletServer@127.4.42.195:0 shutting down...
I20260615 08:04:33.064203 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:04:33.064312 4267 tablet_replica.cc:333] T 941cc916320d4f07822ed6cdc4fdc450 P c95ce4ff5c5f481daf46b4d9e2cbd9fe: stopping tablet replica
I20260615 08:04:33.064363 4267 raft_consensus.cc:2243] T 941cc916320d4f07822ed6cdc4fdc450 P c95ce4ff5c5f481daf46b4d9e2cbd9fe [term 2 FOLLOWER]: Raft consensus shutting down.
I20260615 08:04:33.064409 4267 raft_consensus.cc:2272] T 941cc916320d4f07822ed6cdc4fdc450 P c95ce4ff5c5f481daf46b4d9e2cbd9fe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:04:33.086951 4267 tablet_server.cc:196] TabletServer@127.4.42.195:0 shutdown complete.
I20260615 08:04:33.087716 4267 master.cc:562] Master@127.4.42.254:42869 shutting down...
I20260615 08:04:33.090106 4267 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1860397ba7e04f6c95019e71c41276a7 [term 1 LEADER]: Raft consensus shutting down.
I20260615 08:04:33.090169 4267 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1860397ba7e04f6c95019e71c41276a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:04:33.090188 4267 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1860397ba7e04f6c95019e71c41276a7: stopping tablet replica
I20260615 08:04:33.101610 4267 master.cc:584] Master@127.4.42.254:42869 shutdown complete.
[ OK ] TxnParticipantITest.TestWaitOnAbortCommit (12025 ms)
[ RUN ] TxnParticipantITest.TestProxyBasicCalls
I20260615 08:04:33.119660 4267 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.42.254:36531
I20260615 08:04:33.119828 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:04:33.121274 5505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:04:33.121328 5506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:04:33.121368 4267 server_base.cc:1061] running on GCE node
W20260615 08:04:33.121313 5508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:04:33.121574 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:04:33.121613 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:04:33.121625 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510673121626 us; error 0 us; skew 500 ppm
I20260615 08:04:33.122121 4267 webserver.cc:533] Webserver started at http://127.4.42.254:41073/ using document root <none> and password file <none>
I20260615 08:04:33.122201 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:04:33.122243 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:04:33.122306 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:04:33.122637 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1781510637089012-4267-0/minicluster-data/master-0-root/instance:
uuid: "69a8e73b70e94c6680298c671a100ca8"
format_stamp: "Formatted at 2026-06-15 08:04:33 on dist-test-slave-37n8"
I20260615 08:04:33.123481 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:04:33.123927 5513 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:33.124051 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:33.124111 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1781510637089012-4267-0/minicluster-data/master-0-root
uuid: "69a8e73b70e94c6680298c671a100ca8"
format_stamp: "Formatted at 2026-06-15 08:04:33 on dist-test-slave-37n8"
I20260615 08:04:33.124158 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1781510637089012-4267-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1781510637089012-4267-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1781510637089012-4267-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:04:33.130996 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:04:33.131173 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:04:33.133427 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.254:36531
I20260615 08:04:33.137157 5565 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.254:36531 every 8 connection(s)
I20260615 08:04:33.137284 5566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:04:33.138167 5566 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69a8e73b70e94c6680298c671a100ca8: Bootstrap starting.
I20260615 08:04:33.138442 5566 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 69a8e73b70e94c6680298c671a100ca8: Neither blocks nor log segments found. Creating new log.
I20260615 08:04:33.138911 5566 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69a8e73b70e94c6680298c671a100ca8: No bootstrap required, opened a new log
I20260615 08:04:33.139040 5566 raft_consensus.cc:359] T 00000000000000000000000000000000 P 69a8e73b70e94c6680298c671a100ca8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69a8e73b70e94c6680298c671a100ca8" member_type: VOTER }
I20260615 08:04:33.139097 5566 raft_consensus.cc:385] T 00000000000000000000000000000000 P 69a8e73b70e94c6680298c671a100ca8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:04:33.139129 5566 raft_consensus.cc:740] T 00000000000000000000000000000000 P 69a8e73b70e94c6680298c671a100ca8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69a8e73b70e94c6680298c671a100ca8, State: Initialized, Role: FOLLOWER
I20260615 08:04:33.139183 5566 consensus_queue.cc:260] T 00000000000000000000000000000000 P 69a8e73b70e94c6680298c671a100ca8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69a8e73b70e94c6680298c671a100ca8" member_type: VOTER }
I20260615 08:04:33.139219 5566 raft_consensus.cc:399] T 00000000000000000000000000000000 P 69a8e73b70e94c6680298c671a100ca8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260615 08:04:33.139248 5566 raft_consensus.cc:493] T 00000000000000000000000000000000 P 69a8e73b70e94c6680298c671a100ca8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260615 08:04:33.139278 5566 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 69a8e73b70e94c6680298c671a100ca8 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:04:33.139741 5566 raft_consensus.cc:515] T 00000000000000000000000000000000 P 69a8e73b70e94c6680298c671a100ca8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69a8e73b70e94c6680298c671a100ca8" member_type: VOTER }
I20260615 08:04:33.139815 5566 leader_election.cc:304] T 00000000000000000000000000000000 P 69a8e73b70e94c6680298c671a100ca8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 69a8e73b70e94c6680298c671a100ca8; no voters:
I20260615 08:04:33.139930 5566 leader_election.cc:290] T 00000000000000000000000000000000 P 69a8e73b70e94c6680298c671a100ca8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260615 08:04:33.139976 5569 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 69a8e73b70e94c6680298c671a100ca8 [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:04:33.140072 5566 sys_catalog.cc:565] T 00000000000000000000000000000000 P 69a8e73b70e94c6680298c671a100ca8 [sys.catalog]: configured and running, proceeding with master startup.
I20260615 08:04:33.140112 5569 raft_consensus.cc:697] T 00000000000000000000000000000000 P 69a8e73b70e94c6680298c671a100ca8 [term 1 LEADER]: Becoming Leader. State: Replica: 69a8e73b70e94c6680298c671a100ca8, State: Running, Role: LEADER
I20260615 08:04:33.140172 5569 consensus_queue.cc:237] T 00000000000000000000000000000000 P 69a8e73b70e94c6680298c671a100ca8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69a8e73b70e94c6680298c671a100ca8" member_type: VOTER }
I20260615 08:04:33.140364 5569 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69a8e73b70e94c6680298c671a100ca8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 69a8e73b70e94c6680298c671a100ca8. Latest consensus state: current_term: 1 leader_uuid: "69a8e73b70e94c6680298c671a100ca8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69a8e73b70e94c6680298c671a100ca8" member_type: VOTER } }
I20260615 08:04:33.140471 5569 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69a8e73b70e94c6680298c671a100ca8 [sys.catalog]: This master's current role is: LEADER
I20260615 08:04:33.140362 5570 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69a8e73b70e94c6680298c671a100ca8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "69a8e73b70e94c6680298c671a100ca8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69a8e73b70e94c6680298c671a100ca8" member_type: VOTER } }
I20260615 08:04:33.140686 5575 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260615 08:04:33.140704 5570 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69a8e73b70e94c6680298c671a100ca8 [sys.catalog]: This master's current role is: LEADER
I20260615 08:04:33.140852 5575 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260615 08:04:33.141419 4267 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260615 08:04:33.141441 5575 catalog_manager.cc:1382] Generated new cluster ID: 020208d66ad144eabfa3b06f753a1fdb
I20260615 08:04:33.141477 5575 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260615 08:04:33.149391 5575 catalog_manager.cc:1405] Generated new certificate authority record
I20260615 08:04:33.149773 5575 catalog_manager.cc:1539] Loading token signing keys...
I20260615 08:04:33.153642 5575 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 69a8e73b70e94c6680298c671a100ca8: Generated new TSK 0
I20260615 08:04:33.153719 5575 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260615 08:04:33.156988 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:04:33.158102 5588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:04:33.158071 5590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:04:33.158080 5587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:04:33.158209 4267 server_base.cc:1061] running on GCE node
I20260615 08:04:33.158425 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:04:33.158454 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:04:33.158466 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510673158467 us; error 0 us; skew 500 ppm
I20260615 08:04:33.159015 4267 webserver.cc:533] Webserver started at http://127.4.42.193:36549/ using document root <none> and password file <none>
I20260615 08:04:33.159107 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:04:33.159153 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:04:33.159201 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:04:33.159466 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1781510637089012-4267-0/minicluster-data/ts-0-root/instance:
uuid: "17d3942a4925490587fbacbbcdfb1f5f"
format_stamp: "Formatted at 2026-06-15 08:04:33 on dist-test-slave-37n8"
I20260615 08:04:33.160286 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:04:33.160751 5595 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:33.160907 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:33.160959 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1781510637089012-4267-0/minicluster-data/ts-0-root
uuid: "17d3942a4925490587fbacbbcdfb1f5f"
format_stamp: "Formatted at 2026-06-15 08:04:33 on dist-test-slave-37n8"
I20260615 08:04:33.161003 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1781510637089012-4267-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1781510637089012-4267-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1781510637089012-4267-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:04:33.165968 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:04:33.166127 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:04:33.166273 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:04:33.166447 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:04:33.166486 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:33.166558 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:04:33.166585 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:33.169176 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.193:37723
I20260615 08:04:33.169652 5658 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.193:37723 every 8 connection(s)
I20260615 08:04:33.169723 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:04:33.170614 5661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:04:33.170969 5664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:04:33.171068 5666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:04:33.171422 4267 server_base.cc:1061] running on GCE node
I20260615 08:04:33.171517 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:04:33.171545 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:04:33.171566 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510673171565 us; error 0 us; skew 500 ppm
I20260615 08:04:33.172055 4267 webserver.cc:533] Webserver started at http://127.4.42.194:37271/ using document root <none> and password file <none>
I20260615 08:04:33.172138 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:04:33.172179 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:04:33.172220 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:04:33.172473 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1781510637089012-4267-0/minicluster-data/ts-1-root/instance:
uuid: "0103e1fef6d84f9593d289af36eceede"
format_stamp: "Formatted at 2026-06-15 08:04:33 on dist-test-slave-37n8"
I20260615 08:04:33.173468 5659 heartbeater.cc:344] Connected to a master server at 127.4.42.254:36531
I20260615 08:04:33.173527 5659 heartbeater.cc:461] Registering TS with master...
I20260615 08:04:33.173535 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:04:33.173641 5659 heartbeater.cc:507] Master 127.4.42.254:36531 requested a full tablet report, sending...
I20260615 08:04:33.173861 5530 ts_manager.cc:194] Registered new tserver with Master: 17d3942a4925490587fbacbbcdfb1f5f (127.4.42.193:37723)
I20260615 08:04:33.174042 5671 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:33.174154 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:33.174196 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1781510637089012-4267-0/minicluster-data/ts-1-root
uuid: "0103e1fef6d84f9593d289af36eceede"
format_stamp: "Formatted at 2026-06-15 08:04:33 on dist-test-slave-37n8"
I20260615 08:04:33.174237 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1781510637089012-4267-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1781510637089012-4267-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1781510637089012-4267-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:04:33.174655 5530 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42380
I20260615 08:04:33.181850 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:04:33.182034 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:04:33.182176 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:04:33.182387 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:04:33.182430 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:33.182466 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:04:33.182514 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:33.185132 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.194:37707
I20260615 08:04:33.185178 5734 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.194:37707 every 8 connection(s)
I20260615 08:04:33.185521 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:04:33.186650 5739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:04:33.186615 5738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:04:33.186650 5741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:04:33.186987 4267 server_base.cc:1061] running on GCE node
I20260615 08:04:33.187136 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:04:33.187171 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:04:33.187186 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510673187185 us; error 0 us; skew 500 ppm
I20260615 08:04:33.187674 4267 webserver.cc:533] Webserver started at http://127.4.42.195:33907/ using document root <none> and password file <none>
I20260615 08:04:33.187757 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:04:33.187801 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:04:33.187847 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:04:33.188102 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1781510637089012-4267-0/minicluster-data/ts-2-root/instance:
uuid: "98a438eb201945c3ba48c227fa30b562"
format_stamp: "Formatted at 2026-06-15 08:04:33 on dist-test-slave-37n8"
I20260615 08:04:33.188537 5735 heartbeater.cc:344] Connected to a master server at 127.4.42.254:36531
I20260615 08:04:33.188598 5735 heartbeater.cc:461] Registering TS with master...
I20260615 08:04:33.188704 5735 heartbeater.cc:507] Master 127.4.42.254:36531 requested a full tablet report, sending...
I20260615 08:04:33.188922 5530 ts_manager.cc:194] Registered new tserver with Master: 0103e1fef6d84f9593d289af36eceede (127.4.42.194:37707)
I20260615 08:04:33.189178 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:04:33.189375 5530 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42384
I20260615 08:04:33.189651 5746 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:33.189762 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:33.189807 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1781510637089012-4267-0/minicluster-data/ts-2-root
uuid: "98a438eb201945c3ba48c227fa30b562"
format_stamp: "Formatted at 2026-06-15 08:04:33 on dist-test-slave-37n8"
I20260615 08:04:33.189845 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1781510637089012-4267-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1781510637089012-4267-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyBasicCalls.1781510637089012-4267-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:04:33.216558 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:04:33.216751 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:04:33.216881 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:04:33.217067 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:04:33.217101 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:33.217120 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:04:33.217164 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:33.220171 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.195:41419
I20260615 08:04:33.220266 5809 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.195:41419 every 8 connection(s)
I20260615 08:04:33.222966 5810 heartbeater.cc:344] Connected to a master server at 127.4.42.254:36531
I20260615 08:04:33.223026 5810 heartbeater.cc:461] Registering TS with master...
I20260615 08:04:33.223096 5810 heartbeater.cc:507] Master 127.4.42.254:36531 requested a full tablet report, sending...
I20260615 08:04:33.223285 5530 ts_manager.cc:194] Registered new tserver with Master: 98a438eb201945c3ba48c227fa30b562 (127.4.42.195:41419)
I20260615 08:04:33.223616 4267 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.0032589s
I20260615 08:04:33.223645 5530 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42398
I20260615 08:04:33.227998 5530 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42402:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260615 08:04:33.228148 5530 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260615 08:04:33.232472 5623 tablet_service.cc:1511] Processing CreateTablet for tablet e349d73d66144ef68752a32622c51346 (DEFAULT_TABLE table=test-workload [id=df76f1fa325b4b5aabc8ed3f11215df3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:04:33.232551 5774 tablet_service.cc:1511] Processing CreateTablet for tablet e349d73d66144ef68752a32622c51346 (DEFAULT_TABLE table=test-workload [id=df76f1fa325b4b5aabc8ed3f11215df3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:04:33.232599 5623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e349d73d66144ef68752a32622c51346. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:04:33.232668 5774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e349d73d66144ef68752a32622c51346. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:04:33.233017 5699 tablet_service.cc:1511] Processing CreateTablet for tablet e349d73d66144ef68752a32622c51346 (DEFAULT_TABLE table=test-workload [id=df76f1fa325b4b5aabc8ed3f11215df3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:04:33.233125 5699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e349d73d66144ef68752a32622c51346. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:04:33.233932 5825 tablet_bootstrap.cc:492] T e349d73d66144ef68752a32622c51346 P 17d3942a4925490587fbacbbcdfb1f5f: Bootstrap starting.
I20260615 08:04:33.234200 5826 tablet_bootstrap.cc:492] T e349d73d66144ef68752a32622c51346 P 98a438eb201945c3ba48c227fa30b562: Bootstrap starting.
I20260615 08:04:33.234447 5827 tablet_bootstrap.cc:492] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede: Bootstrap starting.
I20260615 08:04:33.234675 5825 tablet_bootstrap.cc:654] T e349d73d66144ef68752a32622c51346 P 17d3942a4925490587fbacbbcdfb1f5f: Neither blocks nor log segments found. Creating new log.
I20260615 08:04:33.234683 5826 tablet_bootstrap.cc:654] T e349d73d66144ef68752a32622c51346 P 98a438eb201945c3ba48c227fa30b562: Neither blocks nor log segments found. Creating new log.
I20260615 08:04:33.234972 5827 tablet_bootstrap.cc:654] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede: Neither blocks nor log segments found. Creating new log.
I20260615 08:04:33.235383 5826 tablet_bootstrap.cc:492] T e349d73d66144ef68752a32622c51346 P 98a438eb201945c3ba48c227fa30b562: No bootstrap required, opened a new log
I20260615 08:04:33.235424 5826 ts_tablet_manager.cc:1403] T e349d73d66144ef68752a32622c51346 P 98a438eb201945c3ba48c227fa30b562: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260615 08:04:33.235528 5827 tablet_bootstrap.cc:492] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede: No bootstrap required, opened a new log
I20260615 08:04:33.235605 5827 ts_tablet_manager.cc:1403] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260615 08:04:33.235538 5826 raft_consensus.cc:359] T e349d73d66144ef68752a32622c51346 P 98a438eb201945c3ba48c227fa30b562 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17d3942a4925490587fbacbbcdfb1f5f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 37723 } } peers { permanent_uuid: "98a438eb201945c3ba48c227fa30b562" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41419 } } peers { permanent_uuid: "0103e1fef6d84f9593d289af36eceede" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 37707 } }
I20260615 08:04:33.235648 5826 raft_consensus.cc:385] T e349d73d66144ef68752a32622c51346 P 98a438eb201945c3ba48c227fa30b562 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:04:33.235677 5826 raft_consensus.cc:740] T e349d73d66144ef68752a32622c51346 P 98a438eb201945c3ba48c227fa30b562 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98a438eb201945c3ba48c227fa30b562, State: Initialized, Role: FOLLOWER
I20260615 08:04:33.235739 5826 consensus_queue.cc:260] T e349d73d66144ef68752a32622c51346 P 98a438eb201945c3ba48c227fa30b562 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17d3942a4925490587fbacbbcdfb1f5f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 37723 } } peers { permanent_uuid: "98a438eb201945c3ba48c227fa30b562" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41419 } } peers { permanent_uuid: "0103e1fef6d84f9593d289af36eceede" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 37707 } }
I20260615 08:04:33.235772 5827 raft_consensus.cc:359] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17d3942a4925490587fbacbbcdfb1f5f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 37723 } } peers { permanent_uuid: "98a438eb201945c3ba48c227fa30b562" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41419 } } peers { permanent_uuid: "0103e1fef6d84f9593d289af36eceede" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 37707 } }
I20260615 08:04:33.235844 5827 raft_consensus.cc:385] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:04:33.235869 5827 raft_consensus.cc:740] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0103e1fef6d84f9593d289af36eceede, State: Initialized, Role: FOLLOWER
I20260615 08:04:33.235909 5826 ts_tablet_manager.cc:1434] T e349d73d66144ef68752a32622c51346 P 98a438eb201945c3ba48c227fa30b562: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260615 08:04:33.235932 5810 heartbeater.cc:499] Master 127.4.42.254:36531 was elected leader, sending a full tablet report...
I20260615 08:04:33.235936 5827 consensus_queue.cc:260] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17d3942a4925490587fbacbbcdfb1f5f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 37723 } } peers { permanent_uuid: "98a438eb201945c3ba48c227fa30b562" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41419 } } peers { permanent_uuid: "0103e1fef6d84f9593d289af36eceede" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 37707 } }
I20260615 08:04:33.236110 5825 tablet_bootstrap.cc:492] T e349d73d66144ef68752a32622c51346 P 17d3942a4925490587fbacbbcdfb1f5f: No bootstrap required, opened a new log
I20260615 08:04:33.236129 5827 ts_tablet_manager.cc:1434] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260615 08:04:33.236156 5825 ts_tablet_manager.cc:1403] T e349d73d66144ef68752a32622c51346 P 17d3942a4925490587fbacbbcdfb1f5f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260615 08:04:33.236209 5735 heartbeater.cc:499] Master 127.4.42.254:36531 was elected leader, sending a full tablet report...
I20260615 08:04:33.236315 5825 raft_consensus.cc:359] T e349d73d66144ef68752a32622c51346 P 17d3942a4925490587fbacbbcdfb1f5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17d3942a4925490587fbacbbcdfb1f5f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 37723 } } peers { permanent_uuid: "98a438eb201945c3ba48c227fa30b562" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41419 } } peers { permanent_uuid: "0103e1fef6d84f9593d289af36eceede" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 37707 } }
I20260615 08:04:33.236389 5825 raft_consensus.cc:385] T e349d73d66144ef68752a32622c51346 P 17d3942a4925490587fbacbbcdfb1f5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:04:33.236413 5825 raft_consensus.cc:740] T e349d73d66144ef68752a32622c51346 P 17d3942a4925490587fbacbbcdfb1f5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17d3942a4925490587fbacbbcdfb1f5f, State: Initialized, Role: FOLLOWER
I20260615 08:04:33.236486 5825 consensus_queue.cc:260] T e349d73d66144ef68752a32622c51346 P 17d3942a4925490587fbacbbcdfb1f5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17d3942a4925490587fbacbbcdfb1f5f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 37723 } } peers { permanent_uuid: "98a438eb201945c3ba48c227fa30b562" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41419 } } peers { permanent_uuid: "0103e1fef6d84f9593d289af36eceede" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 37707 } }
I20260615 08:04:33.236655 5825 ts_tablet_manager.cc:1434] T e349d73d66144ef68752a32622c51346 P 17d3942a4925490587fbacbbcdfb1f5f: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260615 08:04:33.236730 5659 heartbeater.cc:499] Master 127.4.42.254:36531 was elected leader, sending a full tablet report...
I20260615 08:04:33.288197 5832 raft_consensus.cc:493] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260615 08:04:33.288308 5832 raft_consensus.cc:515] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17d3942a4925490587fbacbbcdfb1f5f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 37723 } } peers { permanent_uuid: "98a438eb201945c3ba48c227fa30b562" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41419 } } peers { permanent_uuid: "0103e1fef6d84f9593d289af36eceede" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 37707 } }
I20260615 08:04:33.288515 5832 leader_election.cc:290] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17d3942a4925490587fbacbbcdfb1f5f (127.4.42.193:37723), 98a438eb201945c3ba48c227fa30b562 (127.4.42.195:41419)
I20260615 08:04:33.291698 5633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e349d73d66144ef68752a32622c51346" candidate_uuid: "0103e1fef6d84f9593d289af36eceede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17d3942a4925490587fbacbbcdfb1f5f" is_pre_election: true
I20260615 08:04:33.291694 5784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e349d73d66144ef68752a32622c51346" candidate_uuid: "0103e1fef6d84f9593d289af36eceede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98a438eb201945c3ba48c227fa30b562" is_pre_election: true
I20260615 08:04:33.291805 5633 raft_consensus.cc:2468] T e349d73d66144ef68752a32622c51346 P 17d3942a4925490587fbacbbcdfb1f5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0103e1fef6d84f9593d289af36eceede in term 0.
I20260615 08:04:33.291808 5784 raft_consensus.cc:2468] T e349d73d66144ef68752a32622c51346 P 98a438eb201945c3ba48c227fa30b562 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0103e1fef6d84f9593d289af36eceede in term 0.
I20260615 08:04:33.291989 5675 leader_election.cc:304] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0103e1fef6d84f9593d289af36eceede, 98a438eb201945c3ba48c227fa30b562; no voters:
I20260615 08:04:33.292098 5832 raft_consensus.cc:2804] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260615 08:04:33.292146 5832 raft_consensus.cc:493] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:04:33.292173 5832 raft_consensus.cc:3060] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:04:33.292856 5832 raft_consensus.cc:515] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17d3942a4925490587fbacbbcdfb1f5f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 37723 } } peers { permanent_uuid: "98a438eb201945c3ba48c227fa30b562" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41419 } } peers { permanent_uuid: "0103e1fef6d84f9593d289af36eceede" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 37707 } }
I20260615 08:04:33.292974 5832 leader_election.cc:290] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede [CANDIDATE]: Term 1 election: Requested vote from peers 17d3942a4925490587fbacbbcdfb1f5f (127.4.42.193:37723), 98a438eb201945c3ba48c227fa30b562 (127.4.42.195:41419)
I20260615 08:04:33.293136 5633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e349d73d66144ef68752a32622c51346" candidate_uuid: "0103e1fef6d84f9593d289af36eceede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17d3942a4925490587fbacbbcdfb1f5f"
I20260615 08:04:33.293170 5784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e349d73d66144ef68752a32622c51346" candidate_uuid: "0103e1fef6d84f9593d289af36eceede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98a438eb201945c3ba48c227fa30b562"
I20260615 08:04:33.293206 5633 raft_consensus.cc:3060] T e349d73d66144ef68752a32622c51346 P 17d3942a4925490587fbacbbcdfb1f5f [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:04:33.293278 5784 raft_consensus.cc:3060] T e349d73d66144ef68752a32622c51346 P 98a438eb201945c3ba48c227fa30b562 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:04:33.293877 5633 raft_consensus.cc:2468] T e349d73d66144ef68752a32622c51346 P 17d3942a4925490587fbacbbcdfb1f5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0103e1fef6d84f9593d289af36eceede in term 1.
I20260615 08:04:33.294005 5784 raft_consensus.cc:2468] T e349d73d66144ef68752a32622c51346 P 98a438eb201945c3ba48c227fa30b562 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0103e1fef6d84f9593d289af36eceede in term 1.
I20260615 08:04:33.294039 5675 leader_election.cc:304] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0103e1fef6d84f9593d289af36eceede, 17d3942a4925490587fbacbbcdfb1f5f; no voters:
I20260615 08:04:33.294117 5832 raft_consensus.cc:2804] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:04:33.294284 5832 raft_consensus.cc:697] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede [term 1 LEADER]: Becoming Leader. State: Replica: 0103e1fef6d84f9593d289af36eceede, State: Running, Role: LEADER
I20260615 08:04:33.294328 5832 consensus_queue.cc:237] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17d3942a4925490587fbacbbcdfb1f5f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 37723 } } peers { permanent_uuid: "98a438eb201945c3ba48c227fa30b562" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41419 } } peers { permanent_uuid: "0103e1fef6d84f9593d289af36eceede" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 37707 } }
I20260615 08:04:33.294880 5530 catalog_manager.cc:5696] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede reported cstate change: term changed from 0 to 1, leader changed from <none> to 0103e1fef6d84f9593d289af36eceede (127.4.42.194). New cstate: current_term: 1 leader_uuid: "0103e1fef6d84f9593d289af36eceede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17d3942a4925490587fbacbbcdfb1f5f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 37723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98a438eb201945c3ba48c227fa30b562" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0103e1fef6d84f9593d289af36eceede" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 37707 } health_report { overall_health: HEALTHY } } }
I20260615 08:04:33.308531 5784 raft_consensus.cc:1275] T e349d73d66144ef68752a32622c51346 P 98a438eb201945c3ba48c227fa30b562 [term 1 FOLLOWER]: Refusing update from remote peer 0103e1fef6d84f9593d289af36eceede: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:04:33.308552 5633 raft_consensus.cc:1275] T e349d73d66144ef68752a32622c51346 P 17d3942a4925490587fbacbbcdfb1f5f [term 1 FOLLOWER]: Refusing update from remote peer 0103e1fef6d84f9593d289af36eceede: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:04:33.308782 5835 consensus_queue.cc:1048] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede [LEADER]: Connected to new peer: Peer: permanent_uuid: "17d3942a4925490587fbacbbcdfb1f5f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 37723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:04:33.308892 5832 consensus_queue.cc:1048] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede [LEADER]: Connected to new peer: Peer: permanent_uuid: "98a438eb201945c3ba48c227fa30b562" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:04:43.812803 5832 raft_consensus.cc:993] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede: : Instructing follower 17d3942a4925490587fbacbbcdfb1f5f to start an election
I20260615 08:04:43.812880 5832 raft_consensus.cc:1081] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede [term 1 LEADER]: Signalling peer 17d3942a4925490587fbacbbcdfb1f5f to start an election
I20260615 08:04:43.813081 5633 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e349d73d66144ef68752a32622c51346"
dest_uuid: "17d3942a4925490587fbacbbcdfb1f5f"
from {username='slave'} at 127.0.0.1:59910
I20260615 08:04:43.813149 5633 raft_consensus.cc:493] T e349d73d66144ef68752a32622c51346 P 17d3942a4925490587fbacbbcdfb1f5f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260615 08:04:43.813169 5633 raft_consensus.cc:3060] T e349d73d66144ef68752a32622c51346 P 17d3942a4925490587fbacbbcdfb1f5f [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:04:43.813750 5633 raft_consensus.cc:515] T e349d73d66144ef68752a32622c51346 P 17d3942a4925490587fbacbbcdfb1f5f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17d3942a4925490587fbacbbcdfb1f5f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 37723 } } peers { permanent_uuid: "98a438eb201945c3ba48c227fa30b562" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41419 } } peers { permanent_uuid: "0103e1fef6d84f9593d289af36eceede" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 37707 } }
I20260615 08:04:43.813905 5633 leader_election.cc:290] T e349d73d66144ef68752a32622c51346 P 17d3942a4925490587fbacbbcdfb1f5f [CANDIDATE]: Term 2 election: Requested vote from peers 98a438eb201945c3ba48c227fa30b562 (127.4.42.195:41419), 0103e1fef6d84f9593d289af36eceede (127.4.42.194:37707)
I20260615 08:04:43.816628 5783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e349d73d66144ef68752a32622c51346" candidate_uuid: "17d3942a4925490587fbacbbcdfb1f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 13565 } } ignore_live_leader: true dest_uuid: "98a438eb201945c3ba48c227fa30b562"
I20260615 08:04:43.816690 5783 raft_consensus.cc:3060] T e349d73d66144ef68752a32622c51346 P 98a438eb201945c3ba48c227fa30b562 [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:04:43.816694 5709 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e349d73d66144ef68752a32622c51346" candidate_uuid: "17d3942a4925490587fbacbbcdfb1f5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 13565 } } ignore_live_leader: true dest_uuid: "0103e1fef6d84f9593d289af36eceede"
I20260615 08:04:43.816803 5709 raft_consensus.cc:3055] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede [term 1 LEADER]: Stepping down as leader of term 1
I20260615 08:04:43.816840 5709 raft_consensus.cc:740] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0103e1fef6d84f9593d289af36eceede, State: Running, Role: LEADER
I20260615 08:04:43.816905 5709 consensus_queue.cc:260] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13565, Committed index: 13565, Last appended: 1.13565, Last appended by leader: 13565, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17d3942a4925490587fbacbbcdfb1f5f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 37723 } } peers { permanent_uuid: "98a438eb201945c3ba48c227fa30b562" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41419 } } peers { permanent_uuid: "0103e1fef6d84f9593d289af36eceede" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 37707 } }
I20260615 08:04:43.816983 5709 raft_consensus.cc:3060] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:04:43.817376 5783 raft_consensus.cc:2468] T e349d73d66144ef68752a32622c51346 P 98a438eb201945c3ba48c227fa30b562 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17d3942a4925490587fbacbbcdfb1f5f in term 2.
I20260615 08:04:43.817550 5599 leader_election.cc:304] T e349d73d66144ef68752a32622c51346 P 17d3942a4925490587fbacbbcdfb1f5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17d3942a4925490587fbacbbcdfb1f5f, 98a438eb201945c3ba48c227fa30b562; no voters:
I20260615 08:04:43.817698 5709 raft_consensus.cc:2468] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 17d3942a4925490587fbacbbcdfb1f5f in term 2.
I20260615 08:04:43.817747 5881 raft_consensus.cc:2804] T e349d73d66144ef68752a32622c51346 P 17d3942a4925490587fbacbbcdfb1f5f [term 2 FOLLOWER]: Leader election won for term 2
I20260615 08:04:43.817881 5881 raft_consensus.cc:697] T e349d73d66144ef68752a32622c51346 P 17d3942a4925490587fbacbbcdfb1f5f [term 2 LEADER]: Becoming Leader. State: Replica: 17d3942a4925490587fbacbbcdfb1f5f, State: Running, Role: LEADER
I20260615 08:04:43.817942 5881 consensus_queue.cc:237] T e349d73d66144ef68752a32622c51346 P 17d3942a4925490587fbacbbcdfb1f5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13565, Committed index: 13565, Last appended: 1.13565, Last appended by leader: 13565, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17d3942a4925490587fbacbbcdfb1f5f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 37723 } } peers { permanent_uuid: "98a438eb201945c3ba48c227fa30b562" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41419 } } peers { permanent_uuid: "0103e1fef6d84f9593d289af36eceede" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 37707 } }
I20260615 08:04:43.818377 5530 catalog_manager.cc:5696] T e349d73d66144ef68752a32622c51346 P 17d3942a4925490587fbacbbcdfb1f5f reported cstate change: term changed from 1 to 2, leader changed from 0103e1fef6d84f9593d289af36eceede (127.4.42.194) to 17d3942a4925490587fbacbbcdfb1f5f (127.4.42.193). New cstate: current_term: 2 leader_uuid: "17d3942a4925490587fbacbbcdfb1f5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "17d3942a4925490587fbacbbcdfb1f5f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 37723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98a438eb201945c3ba48c227fa30b562" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0103e1fef6d84f9593d289af36eceede" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 37707 } health_report { overall_health: UNKNOWN } } }
I20260615 08:04:43.821539 5709 raft_consensus.cc:1275] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede [term 2 FOLLOWER]: Refusing update from remote peer 17d3942a4925490587fbacbbcdfb1f5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 13565. Preceding OpId from leader: term: 2 index: 13567. (index mismatch)
I20260615 08:04:43.821588 5783 raft_consensus.cc:1275] T e349d73d66144ef68752a32622c51346 P 98a438eb201945c3ba48c227fa30b562 [term 2 FOLLOWER]: Refusing update from remote peer 17d3942a4925490587fbacbbcdfb1f5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 13565. Preceding OpId from leader: term: 2 index: 13567. (index mismatch)
I20260615 08:04:43.821762 5882 consensus_queue.cc:1048] T e349d73d66144ef68752a32622c51346 P 17d3942a4925490587fbacbbcdfb1f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "98a438eb201945c3ba48c227fa30b562" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13566, Last known committed idx: 13565, Time since last communication: 0.000s
I20260615 08:04:43.821847 5881 consensus_queue.cc:1048] T e349d73d66144ef68752a32622c51346 P 17d3942a4925490587fbacbbcdfb1f5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0103e1fef6d84f9593d289af36eceede" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 37707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13566, Last known committed idx: 13565, Time since last communication: 0.000s
I20260615 08:04:43.824914 4267 tablet_server.cc:179] TabletServer@127.4.42.193:0 shutting down...
I20260615 08:04:43.827353 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:04:43.827466 4267 tablet_replica.cc:333] T e349d73d66144ef68752a32622c51346 P 17d3942a4925490587fbacbbcdfb1f5f: stopping tablet replica
I20260615 08:04:43.827517 4267 raft_consensus.cc:2243] T e349d73d66144ef68752a32622c51346 P 17d3942a4925490587fbacbbcdfb1f5f [term 2 LEADER]: Raft consensus shutting down.
I20260615 08:04:43.827580 4267 raft_consensus.cc:2272] T e349d73d66144ef68752a32622c51346 P 17d3942a4925490587fbacbbcdfb1f5f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:04:43.841007 4267 tablet_server.cc:196] TabletServer@127.4.42.193:0 shutdown complete.
I20260615 08:04:43.841763 4267 tablet_server.cc:179] TabletServer@127.4.42.194:0 shutting down...
I20260615 08:04:43.844018 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:04:43.844148 4267 tablet_replica.cc:333] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede: stopping tablet replica
I20260615 08:04:43.844210 4267 raft_consensus.cc:2243] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede [term 2 FOLLOWER]: Raft consensus shutting down.
I20260615 08:04:43.844252 4267 raft_consensus.cc:2272] T e349d73d66144ef68752a32622c51346 P 0103e1fef6d84f9593d289af36eceede [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:04:43.853259 4267 tablet_server.cc:196] TabletServer@127.4.42.194:0 shutdown complete.
I20260615 08:04:43.853921 4267 tablet_server.cc:179] TabletServer@127.4.42.195:0 shutting down...
I20260615 08:04:43.857043 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:04:43.857141 4267 tablet_replica.cc:333] T e349d73d66144ef68752a32622c51346 P 98a438eb201945c3ba48c227fa30b562: stopping tablet replica
I20260615 08:04:43.857188 4267 raft_consensus.cc:2243] T e349d73d66144ef68752a32622c51346 P 98a438eb201945c3ba48c227fa30b562 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260615 08:04:43.857227 4267 raft_consensus.cc:2272] T e349d73d66144ef68752a32622c51346 P 98a438eb201945c3ba48c227fa30b562 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:04:43.870554 4267 tablet_server.cc:196] TabletServer@127.4.42.195:0 shutdown complete.
I20260615 08:04:43.871258 4267 master.cc:562] Master@127.4.42.254:36531 shutting down...
I20260615 08:04:43.873514 4267 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 69a8e73b70e94c6680298c671a100ca8 [term 1 LEADER]: Raft consensus shutting down.
I20260615 08:04:43.873572 4267 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 69a8e73b70e94c6680298c671a100ca8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:04:43.873589 4267 tablet_replica.cc:333] T 00000000000000000000000000000000 P 69a8e73b70e94c6680298c671a100ca8: stopping tablet replica
I20260615 08:04:43.885562 4267 master.cc:584] Master@127.4.42.254:36531 shutdown complete.
[ OK ] TxnParticipantITest.TestProxyBasicCalls (10784 ms)
[ RUN ] TxnParticipantITest.TestBeginCommitAfterFinalize
I20260615 08:04:43.903765 4267 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.42.254:37461
I20260615 08:04:43.903936 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:04:43.905285 5897 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:04:43.905303 4267 server_base.cc:1061] running on GCE node
W20260615 08:04:43.905272 5900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:04:43.905557 5898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:04:43.905694 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:04:43.905740 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:04:43.905761 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510683905760 us; error 0 us; skew 500 ppm
I20260615 08:04:43.906280 4267 webserver.cc:533] Webserver started at http://127.4.42.254:35463/ using document root <none> and password file <none>
I20260615 08:04:43.906368 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:04:43.906411 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:04:43.906455 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:04:43.906744 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1781510637089012-4267-0/minicluster-data/master-0-root/instance:
uuid: "597952afe7e0493399f786a66a6efde7"
format_stamp: "Formatted at 2026-06-15 08:04:43 on dist-test-slave-37n8"
I20260615 08:04:43.907615 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:04:43.908053 5905 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:43.908186 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:43.908242 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1781510637089012-4267-0/minicluster-data/master-0-root
uuid: "597952afe7e0493399f786a66a6efde7"
format_stamp: "Formatted at 2026-06-15 08:04:43 on dist-test-slave-37n8"
I20260615 08:04:43.908288 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1781510637089012-4267-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1781510637089012-4267-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1781510637089012-4267-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:04:43.926901 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:04:43.927109 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:04:43.929491 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.254:37461
I20260615 08:04:43.935809 5957 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.254:37461 every 8 connection(s)
I20260615 08:04:43.942561 5958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:04:43.943974 5958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 597952afe7e0493399f786a66a6efde7: Bootstrap starting.
I20260615 08:04:43.944330 5958 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 597952afe7e0493399f786a66a6efde7: Neither blocks nor log segments found. Creating new log.
I20260615 08:04:43.944873 5958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 597952afe7e0493399f786a66a6efde7: No bootstrap required, opened a new log
I20260615 08:04:43.945004 5958 raft_consensus.cc:359] T 00000000000000000000000000000000 P 597952afe7e0493399f786a66a6efde7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "597952afe7e0493399f786a66a6efde7" member_type: VOTER }
I20260615 08:04:43.945078 5958 raft_consensus.cc:385] T 00000000000000000000000000000000 P 597952afe7e0493399f786a66a6efde7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:04:43.945111 5958 raft_consensus.cc:740] T 00000000000000000000000000000000 P 597952afe7e0493399f786a66a6efde7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 597952afe7e0493399f786a66a6efde7, State: Initialized, Role: FOLLOWER
I20260615 08:04:43.945163 5958 consensus_queue.cc:260] T 00000000000000000000000000000000 P 597952afe7e0493399f786a66a6efde7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "597952afe7e0493399f786a66a6efde7" member_type: VOTER }
I20260615 08:04:43.945197 5958 raft_consensus.cc:399] T 00000000000000000000000000000000 P 597952afe7e0493399f786a66a6efde7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260615 08:04:43.945225 5958 raft_consensus.cc:493] T 00000000000000000000000000000000 P 597952afe7e0493399f786a66a6efde7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260615 08:04:43.945254 5958 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 597952afe7e0493399f786a66a6efde7 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:04:43.945683 5958 raft_consensus.cc:515] T 00000000000000000000000000000000 P 597952afe7e0493399f786a66a6efde7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "597952afe7e0493399f786a66a6efde7" member_type: VOTER }
I20260615 08:04:43.945758 5958 leader_election.cc:304] T 00000000000000000000000000000000 P 597952afe7e0493399f786a66a6efde7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 597952afe7e0493399f786a66a6efde7; no voters:
I20260615 08:04:43.945878 5958 leader_election.cc:290] T 00000000000000000000000000000000 P 597952afe7e0493399f786a66a6efde7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260615 08:04:43.945950 5961 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 597952afe7e0493399f786a66a6efde7 [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:04:43.946022 5958 sys_catalog.cc:565] T 00000000000000000000000000000000 P 597952afe7e0493399f786a66a6efde7 [sys.catalog]: configured and running, proceeding with master startup.
I20260615 08:04:43.946085 5961 raft_consensus.cc:697] T 00000000000000000000000000000000 P 597952afe7e0493399f786a66a6efde7 [term 1 LEADER]: Becoming Leader. State: Replica: 597952afe7e0493399f786a66a6efde7, State: Running, Role: LEADER
I20260615 08:04:43.946156 5961 consensus_queue.cc:237] T 00000000000000000000000000000000 P 597952afe7e0493399f786a66a6efde7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "597952afe7e0493399f786a66a6efde7" member_type: VOTER }
I20260615 08:04:43.946421 5962 sys_catalog.cc:455] T 00000000000000000000000000000000 P 597952afe7e0493399f786a66a6efde7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "597952afe7e0493399f786a66a6efde7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "597952afe7e0493399f786a66a6efde7" member_type: VOTER } }
I20260615 08:04:43.946427 5963 sys_catalog.cc:455] T 00000000000000000000000000000000 P 597952afe7e0493399f786a66a6efde7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 597952afe7e0493399f786a66a6efde7. Latest consensus state: current_term: 1 leader_uuid: "597952afe7e0493399f786a66a6efde7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "597952afe7e0493399f786a66a6efde7" member_type: VOTER } }
I20260615 08:04:43.946533 5962 sys_catalog.cc:458] T 00000000000000000000000000000000 P 597952afe7e0493399f786a66a6efde7 [sys.catalog]: This master's current role is: LEADER
I20260615 08:04:43.946540 5963 sys_catalog.cc:458] T 00000000000000000000000000000000 P 597952afe7e0493399f786a66a6efde7 [sys.catalog]: This master's current role is: LEADER
I20260615 08:04:43.946740 5968 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260615 08:04:43.946909 5968 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260615 08:04:43.947345 4267 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260615 08:04:43.947543 5968 catalog_manager.cc:1382] Generated new cluster ID: da32723397414b5893f6f76088d8660d
I20260615 08:04:43.947592 5968 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260615 08:04:43.951092 5968 catalog_manager.cc:1405] Generated new certificate authority record
I20260615 08:04:43.951467 5968 catalog_manager.cc:1539] Loading token signing keys...
I20260615 08:04:43.961727 5968 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 597952afe7e0493399f786a66a6efde7: Generated new TSK 0
I20260615 08:04:43.961807 5968 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260615 08:04:43.962895 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:04:43.964150 5982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:04:43.964224 5979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:04:43.964280 4267 server_base.cc:1061] running on GCE node
W20260615 08:04:43.964359 5980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:04:43.964504 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:04:43.964562 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:04:43.964584 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510683964584 us; error 0 us; skew 500 ppm
I20260615 08:04:43.965119 4267 webserver.cc:533] Webserver started at http://127.4.42.193:44121/ using document root <none> and password file <none>
I20260615 08:04:43.965240 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:04:43.965281 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:04:43.965323 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:04:43.965555 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1781510637089012-4267-0/minicluster-data/ts-0-root/instance:
uuid: "0ef26f0801c74e4c87386034a6d9ac48"
format_stamp: "Formatted at 2026-06-15 08:04:43 on dist-test-slave-37n8"
I20260615 08:04:43.966367 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:04:43.966835 5987 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:43.966951 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:43.967003 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1781510637089012-4267-0/minicluster-data/ts-0-root
uuid: "0ef26f0801c74e4c87386034a6d9ac48"
format_stamp: "Formatted at 2026-06-15 08:04:43 on dist-test-slave-37n8"
I20260615 08:04:43.967046 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1781510637089012-4267-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1781510637089012-4267-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1781510637089012-4267-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:04:43.971307 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:04:43.971493 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:04:43.971652 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:04:43.971839 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:04:43.971882 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:43.971920 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:04:43.971946 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:43.974608 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.193:32821
I20260615 08:04:43.974633 6050 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.193:32821 every 8 connection(s)
I20260615 08:04:43.974958 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:04:43.975977 6056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:04:43.976001 6055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:04:43.976015 6058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:04:43.977237 4267 server_base.cc:1061] running on GCE node
I20260615 08:04:43.977403 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:04:43.977447 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:04:43.977473 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510683977473 us; error 0 us; skew 500 ppm
I20260615 08:04:43.978274 4267 webserver.cc:533] Webserver started at http://127.4.42.194:45955/ using document root <none> and password file <none>
I20260615 08:04:43.978325 6051 heartbeater.cc:344] Connected to a master server at 127.4.42.254:37461
I20260615 08:04:43.978365 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:04:43.978374 6051 heartbeater.cc:461] Registering TS with master...
I20260615 08:04:43.978426 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:04:43.978533 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:04:43.978569 6051 heartbeater.cc:507] Master 127.4.42.254:37461 requested a full tablet report, sending...
I20260615 08:04:43.978812 5922 ts_manager.cc:194] Registered new tserver with Master: 0ef26f0801c74e4c87386034a6d9ac48 (127.4.42.193:32821)
I20260615 08:04:43.978826 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1781510637089012-4267-0/minicluster-data/ts-1-root/instance:
uuid: "500d2e8cb58c4dcbba4013e8aa7ad647"
format_stamp: "Formatted at 2026-06-15 08:04:43 on dist-test-slave-37n8"
I20260615 08:04:43.979410 5922 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39572
I20260615 08:04:43.979848 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:04:43.980288 6063 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:43.980422 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:43.980479 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1781510637089012-4267-0/minicluster-data/ts-1-root
uuid: "500d2e8cb58c4dcbba4013e8aa7ad647"
format_stamp: "Formatted at 2026-06-15 08:04:43 on dist-test-slave-37n8"
I20260615 08:04:43.980535 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1781510637089012-4267-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1781510637089012-4267-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1781510637089012-4267-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:04:43.989141 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:04:43.989315 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:04:43.989454 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:04:43.989637 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:04:43.989682 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:43.989720 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:04:43.989748 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:43.992442 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.194:44371
I20260615 08:04:43.992496 6126 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.194:44371 every 8 connection(s)
I20260615 08:04:43.992857 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:04:43.993765 6130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:04:43.993986 6131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:04:43.994354 4267 server_base.cc:1061] running on GCE node
W20260615 08:04:43.994524 6133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:04:43.994694 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:04:43.994755 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:04:43.994781 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510683994780 us; error 0 us; skew 500 ppm
I20260615 08:04:43.995398 4267 webserver.cc:533] Webserver started at http://127.4.42.195:42677/ using document root <none> and password file <none>
I20260615 08:04:43.995514 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:04:43.995561 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:04:43.995616 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:04:43.995918 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1781510637089012-4267-0/minicluster-data/ts-2-root/instance:
uuid: "7dc269b0283d4849a69dccd180b3428c"
format_stamp: "Formatted at 2026-06-15 08:04:43 on dist-test-slave-37n8"
I20260615 08:04:43.995980 6127 heartbeater.cc:344] Connected to a master server at 127.4.42.254:37461
I20260615 08:04:43.996049 6127 heartbeater.cc:461] Registering TS with master...
I20260615 08:04:43.996143 6127 heartbeater.cc:507] Master 127.4.42.254:37461 requested a full tablet report, sending...
I20260615 08:04:43.996371 5922 ts_manager.cc:194] Registered new tserver with Master: 500d2e8cb58c4dcbba4013e8aa7ad647 (127.4.42.194:44371)
I20260615 08:04:43.996698 5922 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39578
I20260615 08:04:43.996946 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:04:43.997483 6138 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:43.997632 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:43.997685 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1781510637089012-4267-0/minicluster-data/ts-2-root
uuid: "7dc269b0283d4849a69dccd180b3428c"
format_stamp: "Formatted at 2026-06-15 08:04:43 on dist-test-slave-37n8"
I20260615 08:04:43.997735 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1781510637089012-4267-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1781510637089012-4267-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestBeginCommitAfterFinalize.1781510637089012-4267-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:04:44.006989 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:04:44.007175 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:04:44.007326 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:04:44.007527 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:04:44.007555 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:44.007573 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:04:44.007616 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:44.010799 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.195:42727
I20260615 08:04:44.010851 6201 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.195:42727 every 8 connection(s)
I20260615 08:04:44.013602 6202 heartbeater.cc:344] Connected to a master server at 127.4.42.254:37461
I20260615 08:04:44.013662 6202 heartbeater.cc:461] Registering TS with master...
I20260615 08:04:44.013729 6202 heartbeater.cc:507] Master 127.4.42.254:37461 requested a full tablet report, sending...
I20260615 08:04:44.013931 5922 ts_manager.cc:194] Registered new tserver with Master: 7dc269b0283d4849a69dccd180b3428c (127.4.42.195:42727)
I20260615 08:04:44.014215 5922 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39592
I20260615 08:04:44.014318 4267 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003339544s
I20260615 08:04:44.018903 5922 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39602:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260615 08:04:44.019057 5922 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260615 08:04:44.023391 6015 tablet_service.cc:1511] Processing CreateTablet for tablet dcfbd516b79d4a44b01477b33aeb195b (DEFAULT_TABLE table=test-workload [id=5551e677b4bc41af8ce32cb3b2dc6d9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:04:44.023521 6015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcfbd516b79d4a44b01477b33aeb195b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:04:44.023989 6091 tablet_service.cc:1511] Processing CreateTablet for tablet dcfbd516b79d4a44b01477b33aeb195b (DEFAULT_TABLE table=test-workload [id=5551e677b4bc41af8ce32cb3b2dc6d9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:04:44.024097 6091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcfbd516b79d4a44b01477b33aeb195b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:04:44.024868 6217 tablet_bootstrap.cc:492] T dcfbd516b79d4a44b01477b33aeb195b P 0ef26f0801c74e4c87386034a6d9ac48: Bootstrap starting.
I20260615 08:04:44.025269 6217 tablet_bootstrap.cc:654] T dcfbd516b79d4a44b01477b33aeb195b P 0ef26f0801c74e4c87386034a6d9ac48: Neither blocks nor log segments found. Creating new log.
I20260615 08:04:44.025452 6218 tablet_bootstrap.cc:492] T dcfbd516b79d4a44b01477b33aeb195b P 500d2e8cb58c4dcbba4013e8aa7ad647: Bootstrap starting.
I20260615 08:04:44.025822 6166 tablet_service.cc:1511] Processing CreateTablet for tablet dcfbd516b79d4a44b01477b33aeb195b (DEFAULT_TABLE table=test-workload [id=5551e677b4bc41af8ce32cb3b2dc6d9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:04:44.025951 6166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcfbd516b79d4a44b01477b33aeb195b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:04:44.026034 6218 tablet_bootstrap.cc:654] T dcfbd516b79d4a44b01477b33aeb195b P 500d2e8cb58c4dcbba4013e8aa7ad647: Neither blocks nor log segments found. Creating new log.
I20260615 08:04:44.026223 6217 tablet_bootstrap.cc:492] T dcfbd516b79d4a44b01477b33aeb195b P 0ef26f0801c74e4c87386034a6d9ac48: No bootstrap required, opened a new log
I20260615 08:04:44.026278 6217 ts_tablet_manager.cc:1403] T dcfbd516b79d4a44b01477b33aeb195b P 0ef26f0801c74e4c87386034a6d9ac48: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:04:44.026446 6217 raft_consensus.cc:359] T dcfbd516b79d4a44b01477b33aeb195b P 0ef26f0801c74e4c87386034a6d9ac48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "500d2e8cb58c4dcbba4013e8aa7ad647" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 44371 } } peers { permanent_uuid: "0ef26f0801c74e4c87386034a6d9ac48" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 32821 } } peers { permanent_uuid: "7dc269b0283d4849a69dccd180b3428c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42727 } }
I20260615 08:04:44.026536 6217 raft_consensus.cc:385] T dcfbd516b79d4a44b01477b33aeb195b P 0ef26f0801c74e4c87386034a6d9ac48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:04:44.026566 6217 raft_consensus.cc:740] T dcfbd516b79d4a44b01477b33aeb195b P 0ef26f0801c74e4c87386034a6d9ac48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ef26f0801c74e4c87386034a6d9ac48, State: Initialized, Role: FOLLOWER
I20260615 08:04:44.026608 6217 consensus_queue.cc:260] T dcfbd516b79d4a44b01477b33aeb195b P 0ef26f0801c74e4c87386034a6d9ac48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "500d2e8cb58c4dcbba4013e8aa7ad647" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 44371 } } peers { permanent_uuid: "0ef26f0801c74e4c87386034a6d9ac48" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 32821 } } peers { permanent_uuid: "7dc269b0283d4849a69dccd180b3428c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42727 } }
I20260615 08:04:44.026645 6218 tablet_bootstrap.cc:492] T dcfbd516b79d4a44b01477b33aeb195b P 500d2e8cb58c4dcbba4013e8aa7ad647: No bootstrap required, opened a new log
I20260615 08:04:44.026690 6218 ts_tablet_manager.cc:1403] T dcfbd516b79d4a44b01477b33aeb195b P 500d2e8cb58c4dcbba4013e8aa7ad647: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:04:44.026777 6217 ts_tablet_manager.cc:1434] T dcfbd516b79d4a44b01477b33aeb195b P 0ef26f0801c74e4c87386034a6d9ac48: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260615 08:04:44.026818 6051 heartbeater.cc:499] Master 127.4.42.254:37461 was elected leader, sending a full tablet report...
I20260615 08:04:44.026840 6218 raft_consensus.cc:359] T dcfbd516b79d4a44b01477b33aeb195b P 500d2e8cb58c4dcbba4013e8aa7ad647 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "500d2e8cb58c4dcbba4013e8aa7ad647" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 44371 } } peers { permanent_uuid: "0ef26f0801c74e4c87386034a6d9ac48" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 32821 } } peers { permanent_uuid: "7dc269b0283d4849a69dccd180b3428c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42727 } }
I20260615 08:04:44.026896 6218 raft_consensus.cc:385] T dcfbd516b79d4a44b01477b33aeb195b P 500d2e8cb58c4dcbba4013e8aa7ad647 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:04:44.026916 6218 raft_consensus.cc:740] T dcfbd516b79d4a44b01477b33aeb195b P 500d2e8cb58c4dcbba4013e8aa7ad647 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 500d2e8cb58c4dcbba4013e8aa7ad647, State: Initialized, Role: FOLLOWER
I20260615 08:04:44.026962 6218 consensus_queue.cc:260] T dcfbd516b79d4a44b01477b33aeb195b P 500d2e8cb58c4dcbba4013e8aa7ad647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "500d2e8cb58c4dcbba4013e8aa7ad647" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 44371 } } peers { permanent_uuid: "0ef26f0801c74e4c87386034a6d9ac48" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 32821 } } peers { permanent_uuid: "7dc269b0283d4849a69dccd180b3428c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42727 } }
I20260615 08:04:44.027124 6218 ts_tablet_manager.cc:1434] T dcfbd516b79d4a44b01477b33aeb195b P 500d2e8cb58c4dcbba4013e8aa7ad647: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260615 08:04:44.027225 6127 heartbeater.cc:499] Master 127.4.42.254:37461 was elected leader, sending a full tablet report...
I20260615 08:04:44.027360 6223 tablet_bootstrap.cc:492] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c: Bootstrap starting.
I20260615 08:04:44.027801 6223 tablet_bootstrap.cc:654] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c: Neither blocks nor log segments found. Creating new log.
I20260615 08:04:44.028308 6223 tablet_bootstrap.cc:492] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c: No bootstrap required, opened a new log
I20260615 08:04:44.028429 6223 ts_tablet_manager.cc:1403] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:04:44.028592 6223 raft_consensus.cc:359] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "500d2e8cb58c4dcbba4013e8aa7ad647" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 44371 } } peers { permanent_uuid: "0ef26f0801c74e4c87386034a6d9ac48" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 32821 } } peers { permanent_uuid: "7dc269b0283d4849a69dccd180b3428c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42727 } }
I20260615 08:04:44.028671 6223 raft_consensus.cc:385] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:04:44.028707 6223 raft_consensus.cc:740] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dc269b0283d4849a69dccd180b3428c, State: Initialized, Role: FOLLOWER
I20260615 08:04:44.028756 6223 consensus_queue.cc:260] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "500d2e8cb58c4dcbba4013e8aa7ad647" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 44371 } } peers { permanent_uuid: "0ef26f0801c74e4c87386034a6d9ac48" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 32821 } } peers { permanent_uuid: "7dc269b0283d4849a69dccd180b3428c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42727 } }
I20260615 08:04:44.028914 6223 ts_tablet_manager.cc:1434] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:44.028944 6202 heartbeater.cc:499] Master 127.4.42.254:37461 was elected leader, sending a full tablet report...
I20260615 08:04:44.053021 6225 raft_consensus.cc:493] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260615 08:04:44.053081 6225 raft_consensus.cc:515] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "500d2e8cb58c4dcbba4013e8aa7ad647" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 44371 } } peers { permanent_uuid: "0ef26f0801c74e4c87386034a6d9ac48" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 32821 } } peers { permanent_uuid: "7dc269b0283d4849a69dccd180b3428c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42727 } }
I20260615 08:04:44.053195 6225 leader_election.cc:290] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 500d2e8cb58c4dcbba4013e8aa7ad647 (127.4.42.194:44371), 0ef26f0801c74e4c87386034a6d9ac48 (127.4.42.193:32821)
I20260615 08:04:44.055670 6101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcfbd516b79d4a44b01477b33aeb195b" candidate_uuid: "7dc269b0283d4849a69dccd180b3428c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "500d2e8cb58c4dcbba4013e8aa7ad647" is_pre_election: true
I20260615 08:04:44.055758 6101 raft_consensus.cc:2468] T dcfbd516b79d4a44b01477b33aeb195b P 500d2e8cb58c4dcbba4013e8aa7ad647 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dc269b0283d4849a69dccd180b3428c in term 0.
I20260615 08:04:44.055907 6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcfbd516b79d4a44b01477b33aeb195b" candidate_uuid: "7dc269b0283d4849a69dccd180b3428c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ef26f0801c74e4c87386034a6d9ac48" is_pre_election: true
I20260615 08:04:44.055941 6141 leader_election.cc:304] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 500d2e8cb58c4dcbba4013e8aa7ad647, 7dc269b0283d4849a69dccd180b3428c; no voters:
I20260615 08:04:44.055985 6025 raft_consensus.cc:2468] T dcfbd516b79d4a44b01477b33aeb195b P 0ef26f0801c74e4c87386034a6d9ac48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dc269b0283d4849a69dccd180b3428c in term 0.
I20260615 08:04:44.056082 6225 raft_consensus.cc:2804] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260615 08:04:44.056118 6225 raft_consensus.cc:493] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:04:44.056141 6225 raft_consensus.cc:3060] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:04:44.056703 6225 raft_consensus.cc:515] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "500d2e8cb58c4dcbba4013e8aa7ad647" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 44371 } } peers { permanent_uuid: "0ef26f0801c74e4c87386034a6d9ac48" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 32821 } } peers { permanent_uuid: "7dc269b0283d4849a69dccd180b3428c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42727 } }
I20260615 08:04:44.056825 6225 leader_election.cc:290] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c [CANDIDATE]: Term 1 election: Requested vote from peers 500d2e8cb58c4dcbba4013e8aa7ad647 (127.4.42.194:44371), 0ef26f0801c74e4c87386034a6d9ac48 (127.4.42.193:32821)
I20260615 08:04:44.056989 6025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcfbd516b79d4a44b01477b33aeb195b" candidate_uuid: "7dc269b0283d4849a69dccd180b3428c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ef26f0801c74e4c87386034a6d9ac48"
I20260615 08:04:44.056989 6101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcfbd516b79d4a44b01477b33aeb195b" candidate_uuid: "7dc269b0283d4849a69dccd180b3428c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "500d2e8cb58c4dcbba4013e8aa7ad647"
I20260615 08:04:44.057086 6025 raft_consensus.cc:3060] T dcfbd516b79d4a44b01477b33aeb195b P 0ef26f0801c74e4c87386034a6d9ac48 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:04:44.057093 6101 raft_consensus.cc:3060] T dcfbd516b79d4a44b01477b33aeb195b P 500d2e8cb58c4dcbba4013e8aa7ad647 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:04:44.057766 6025 raft_consensus.cc:2468] T dcfbd516b79d4a44b01477b33aeb195b P 0ef26f0801c74e4c87386034a6d9ac48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dc269b0283d4849a69dccd180b3428c in term 1.
I20260615 08:04:44.057766 6101 raft_consensus.cc:2468] T dcfbd516b79d4a44b01477b33aeb195b P 500d2e8cb58c4dcbba4013e8aa7ad647 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dc269b0283d4849a69dccd180b3428c in term 1.
I20260615 08:04:44.057955 6141 leader_election.cc:304] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ef26f0801c74e4c87386034a6d9ac48, 7dc269b0283d4849a69dccd180b3428c; no voters:
I20260615 08:04:44.058055 6225 raft_consensus.cc:2804] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:04:44.058175 6225 raft_consensus.cc:697] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c [term 1 LEADER]: Becoming Leader. State: Replica: 7dc269b0283d4849a69dccd180b3428c, State: Running, Role: LEADER
I20260615 08:04:44.058214 6225 consensus_queue.cc:237] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "500d2e8cb58c4dcbba4013e8aa7ad647" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 44371 } } peers { permanent_uuid: "0ef26f0801c74e4c87386034a6d9ac48" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 32821 } } peers { permanent_uuid: "7dc269b0283d4849a69dccd180b3428c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42727 } }
I20260615 08:04:44.058746 5921 catalog_manager.cc:5696] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7dc269b0283d4849a69dccd180b3428c (127.4.42.195). New cstate: current_term: 1 leader_uuid: "7dc269b0283d4849a69dccd180b3428c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "500d2e8cb58c4dcbba4013e8aa7ad647" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 44371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ef26f0801c74e4c87386034a6d9ac48" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 32821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7dc269b0283d4849a69dccd180b3428c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42727 } health_report { overall_health: HEALTHY } } }
I20260615 08:04:44.073232 6025 raft_consensus.cc:1275] T dcfbd516b79d4a44b01477b33aeb195b P 0ef26f0801c74e4c87386034a6d9ac48 [term 1 FOLLOWER]: Refusing update from remote peer 7dc269b0283d4849a69dccd180b3428c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:04:44.073272 6101 raft_consensus.cc:1275] T dcfbd516b79d4a44b01477b33aeb195b P 500d2e8cb58c4dcbba4013e8aa7ad647 [term 1 FOLLOWER]: Refusing update from remote peer 7dc269b0283d4849a69dccd180b3428c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:04:44.073453 6225 consensus_queue.cc:1048] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c [LEADER]: Connected to new peer: Peer: permanent_uuid: "500d2e8cb58c4dcbba4013e8aa7ad647" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 44371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:04:44.073580 6227 consensus_queue.cc:1048] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ef26f0801c74e4c87386034a6d9ac48" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 32821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:04:44.076004 6235 mvcc.cc:204] Tried to move back new op lower bound from 7297067761962512384 to 7297067761903067136. Current Snapshot: MvccSnapshot[applied={T|T < 7297067761962512384}]
I20260615 08:04:54.485718 6225 raft_consensus.cc:993] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c: : Instructing follower 0ef26f0801c74e4c87386034a6d9ac48 to start an election
I20260615 08:04:54.485821 6225 raft_consensus.cc:1081] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c [term 1 LEADER]: Signalling peer 0ef26f0801c74e4c87386034a6d9ac48 to start an election
I20260615 08:04:54.486037 6024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dcfbd516b79d4a44b01477b33aeb195b"
dest_uuid: "0ef26f0801c74e4c87386034a6d9ac48"
from {username='slave'} at 127.0.0.1:58636
I20260615 08:04:54.486132 6024 raft_consensus.cc:493] T dcfbd516b79d4a44b01477b33aeb195b P 0ef26f0801c74e4c87386034a6d9ac48 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260615 08:04:54.486153 6024 raft_consensus.cc:3060] T dcfbd516b79d4a44b01477b33aeb195b P 0ef26f0801c74e4c87386034a6d9ac48 [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:04:54.486856 6024 raft_consensus.cc:515] T dcfbd516b79d4a44b01477b33aeb195b P 0ef26f0801c74e4c87386034a6d9ac48 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "500d2e8cb58c4dcbba4013e8aa7ad647" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 44371 } } peers { permanent_uuid: "0ef26f0801c74e4c87386034a6d9ac48" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 32821 } } peers { permanent_uuid: "7dc269b0283d4849a69dccd180b3428c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42727 } }
I20260615 08:04:54.487046 6024 leader_election.cc:290] T dcfbd516b79d4a44b01477b33aeb195b P 0ef26f0801c74e4c87386034a6d9ac48 [CANDIDATE]: Term 2 election: Requested vote from peers 500d2e8cb58c4dcbba4013e8aa7ad647 (127.4.42.194:44371), 7dc269b0283d4849a69dccd180b3428c (127.4.42.195:42727)
I20260615 08:04:54.490612 6100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcfbd516b79d4a44b01477b33aeb195b" candidate_uuid: "0ef26f0801c74e4c87386034a6d9ac48" candidate_term: 2 candidate_status { last_received { term: 1 index: 13594 } } ignore_live_leader: true dest_uuid: "500d2e8cb58c4dcbba4013e8aa7ad647"
I20260615 08:04:54.490679 6100 raft_consensus.cc:3060] T dcfbd516b79d4a44b01477b33aeb195b P 500d2e8cb58c4dcbba4013e8aa7ad647 [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:04:54.490638 6176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcfbd516b79d4a44b01477b33aeb195b" candidate_uuid: "0ef26f0801c74e4c87386034a6d9ac48" candidate_term: 2 candidate_status { last_received { term: 1 index: 13594 } } ignore_live_leader: true dest_uuid: "7dc269b0283d4849a69dccd180b3428c"
I20260615 08:04:54.490721 6176 raft_consensus.cc:3055] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c [term 1 LEADER]: Stepping down as leader of term 1
I20260615 08:04:54.490760 6176 raft_consensus.cc:740] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7dc269b0283d4849a69dccd180b3428c, State: Running, Role: LEADER
I20260615 08:04:54.490828 6176 consensus_queue.cc:260] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13594, Committed index: 13594, Last appended: 1.13594, Last appended by leader: 13594, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "500d2e8cb58c4dcbba4013e8aa7ad647" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 44371 } } peers { permanent_uuid: "0ef26f0801c74e4c87386034a6d9ac48" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 32821 } } peers { permanent_uuid: "7dc269b0283d4849a69dccd180b3428c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42727 } }
I20260615 08:04:54.490950 6176 raft_consensus.cc:3060] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:04:54.491371 6100 raft_consensus.cc:2468] T dcfbd516b79d4a44b01477b33aeb195b P 500d2e8cb58c4dcbba4013e8aa7ad647 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ef26f0801c74e4c87386034a6d9ac48 in term 2.
I20260615 08:04:54.491559 5990 leader_election.cc:304] T dcfbd516b79d4a44b01477b33aeb195b P 0ef26f0801c74e4c87386034a6d9ac48 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ef26f0801c74e4c87386034a6d9ac48, 500d2e8cb58c4dcbba4013e8aa7ad647; no voters:
I20260615 08:04:54.491622 6176 raft_consensus.cc:2468] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ef26f0801c74e4c87386034a6d9ac48 in term 2.
I20260615 08:04:54.491772 6270 raft_consensus.cc:2804] T dcfbd516b79d4a44b01477b33aeb195b P 0ef26f0801c74e4c87386034a6d9ac48 [term 2 FOLLOWER]: Leader election won for term 2
I20260615 08:04:54.491904 6270 raft_consensus.cc:697] T dcfbd516b79d4a44b01477b33aeb195b P 0ef26f0801c74e4c87386034a6d9ac48 [term 2 LEADER]: Becoming Leader. State: Replica: 0ef26f0801c74e4c87386034a6d9ac48, State: Running, Role: LEADER
I20260615 08:04:54.492013 6270 consensus_queue.cc:237] T dcfbd516b79d4a44b01477b33aeb195b P 0ef26f0801c74e4c87386034a6d9ac48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13594, Committed index: 13594, Last appended: 1.13594, Last appended by leader: 13594, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "500d2e8cb58c4dcbba4013e8aa7ad647" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 44371 } } peers { permanent_uuid: "0ef26f0801c74e4c87386034a6d9ac48" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 32821 } } peers { permanent_uuid: "7dc269b0283d4849a69dccd180b3428c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42727 } }
I20260615 08:04:54.492508 5920 catalog_manager.cc:5696] T dcfbd516b79d4a44b01477b33aeb195b P 0ef26f0801c74e4c87386034a6d9ac48 reported cstate change: term changed from 1 to 2, leader changed from 7dc269b0283d4849a69dccd180b3428c (127.4.42.195) to 0ef26f0801c74e4c87386034a6d9ac48 (127.4.42.193). New cstate: current_term: 2 leader_uuid: "0ef26f0801c74e4c87386034a6d9ac48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "500d2e8cb58c4dcbba4013e8aa7ad647" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 44371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ef26f0801c74e4c87386034a6d9ac48" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 32821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7dc269b0283d4849a69dccd180b3428c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42727 } health_report { overall_health: UNKNOWN } } }
I20260615 08:04:54.496583 6176 raft_consensus.cc:1275] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c [term 2 FOLLOWER]: Refusing update from remote peer 0ef26f0801c74e4c87386034a6d9ac48: Log matching property violated. Preceding OpId in replica: term: 1 index: 13594. Preceding OpId from leader: term: 2 index: 13596. (index mismatch)
I20260615 08:04:54.496592 6100 raft_consensus.cc:1275] T dcfbd516b79d4a44b01477b33aeb195b P 500d2e8cb58c4dcbba4013e8aa7ad647 [term 2 FOLLOWER]: Refusing update from remote peer 0ef26f0801c74e4c87386034a6d9ac48: Log matching property violated. Preceding OpId in replica: term: 1 index: 13594. Preceding OpId from leader: term: 2 index: 13596. (index mismatch)
I20260615 08:04:54.496857 6271 consensus_queue.cc:1048] T dcfbd516b79d4a44b01477b33aeb195b P 0ef26f0801c74e4c87386034a6d9ac48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dc269b0283d4849a69dccd180b3428c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42727 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13595, Last known committed idx: 13594, Time since last communication: 0.000s
I20260615 08:04:54.496942 6270 consensus_queue.cc:1048] T dcfbd516b79d4a44b01477b33aeb195b P 0ef26f0801c74e4c87386034a6d9ac48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "500d2e8cb58c4dcbba4013e8aa7ad647" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 44371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13595, Last known committed idx: 13594, Time since last communication: 0.000s
W20260615 08:04:54.500165 6236 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46748: Illegal state: Transaction 0 commit already in progress
I20260615 08:04:54.500463 4267 tablet_server.cc:179] TabletServer@127.4.42.193:0 shutting down...
I20260615 08:04:54.503185 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:04:54.503322 4267 tablet_replica.cc:333] T dcfbd516b79d4a44b01477b33aeb195b P 0ef26f0801c74e4c87386034a6d9ac48: stopping tablet replica
I20260615 08:04:54.503372 4267 raft_consensus.cc:2243] T dcfbd516b79d4a44b01477b33aeb195b P 0ef26f0801c74e4c87386034a6d9ac48 [term 2 LEADER]: Raft consensus shutting down.
I20260615 08:04:54.503424 4267 raft_consensus.cc:2272] T dcfbd516b79d4a44b01477b33aeb195b P 0ef26f0801c74e4c87386034a6d9ac48 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:04:54.517568 4267 tablet_server.cc:196] TabletServer@127.4.42.193:0 shutdown complete.
I20260615 08:04:54.518345 4267 tablet_server.cc:179] TabletServer@127.4.42.194:0 shutting down...
I20260615 08:04:54.521910 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:04:54.522022 4267 tablet_replica.cc:333] T dcfbd516b79d4a44b01477b33aeb195b P 500d2e8cb58c4dcbba4013e8aa7ad647: stopping tablet replica
I20260615 08:04:54.522079 4267 raft_consensus.cc:2243] T dcfbd516b79d4a44b01477b33aeb195b P 500d2e8cb58c4dcbba4013e8aa7ad647 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260615 08:04:54.522125 4267 raft_consensus.cc:2272] T dcfbd516b79d4a44b01477b33aeb195b P 500d2e8cb58c4dcbba4013e8aa7ad647 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:04:54.534966 4267 tablet_server.cc:196] TabletServer@127.4.42.194:0 shutdown complete.
I20260615 08:04:54.535806 4267 tablet_server.cc:179] TabletServer@127.4.42.195:0 shutting down...
I20260615 08:04:54.538450 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:04:54.538681 4267 tablet_replica.cc:333] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c: stopping tablet replica
I20260615 08:04:54.538746 4267 raft_consensus.cc:2243] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260615 08:04:54.538794 4267 raft_consensus.cc:2272] T dcfbd516b79d4a44b01477b33aeb195b P 7dc269b0283d4849a69dccd180b3428c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:04:54.552721 4267 tablet_server.cc:196] TabletServer@127.4.42.195:0 shutdown complete.
I20260615 08:04:54.553501 4267 master.cc:562] Master@127.4.42.254:37461 shutting down...
I20260615 08:04:54.556475 4267 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 597952afe7e0493399f786a66a6efde7 [term 1 LEADER]: Raft consensus shutting down.
I20260615 08:04:54.556540 4267 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 597952afe7e0493399f786a66a6efde7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:04:54.556557 4267 tablet_replica.cc:333] T 00000000000000000000000000000000 P 597952afe7e0493399f786a66a6efde7: stopping tablet replica
I20260615 08:04:54.559118 4267 master.cc:584] Master@127.4.42.254:37461 shutdown complete.
[ OK ] TxnParticipantITest.TestBeginCommitAfterFinalize (10673 ms)
[ RUN ] TxnParticipantITest.TestProxyErrorWhenNotBegun
I20260615 08:04:54.577548 4267 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.42.254:41973
I20260615 08:04:54.577728 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:04:54.579258 6280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:04:54.579346 4267 server_base.cc:1061] running on GCE node
W20260615 08:04:54.579295 6282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:04:54.579345 6279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:04:54.579687 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:04:54.579725 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:04:54.579756 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510694579754 us; error 0 us; skew 500 ppm
I20260615 08:04:54.580320 4267 webserver.cc:533] Webserver started at http://127.4.42.254:33921/ using document root <none> and password file <none>
I20260615 08:04:54.580427 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:04:54.580471 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:04:54.580513 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:04:54.580756 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/master-0-root/instance:
uuid: "d3b3cabe5a094202bf2830e230a36a92"
format_stamp: "Formatted at 2026-06-15 08:04:54 on dist-test-slave-37n8"
I20260615 08:04:54.581656 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:04:54.582139 6287 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:54.582276 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:54.582332 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/master-0-root
uuid: "d3b3cabe5a094202bf2830e230a36a92"
format_stamp: "Formatted at 2026-06-15 08:04:54 on dist-test-slave-37n8"
I20260615 08:04:54.582377 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:04:54.613544 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:04:54.613766 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:04:54.616495 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.254:41973
I20260615 08:04:54.627764 6339 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.254:41973 every 8 connection(s)
I20260615 08:04:54.627887 6340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:04:54.628826 6340 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3b3cabe5a094202bf2830e230a36a92: Bootstrap starting.
I20260615 08:04:54.629088 6340 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d3b3cabe5a094202bf2830e230a36a92: Neither blocks nor log segments found. Creating new log.
I20260615 08:04:54.629571 6340 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3b3cabe5a094202bf2830e230a36a92: No bootstrap required, opened a new log
I20260615 08:04:54.629675 6340 raft_consensus.cc:359] T 00000000000000000000000000000000 P d3b3cabe5a094202bf2830e230a36a92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3b3cabe5a094202bf2830e230a36a92" member_type: VOTER }
I20260615 08:04:54.629719 6340 raft_consensus.cc:385] T 00000000000000000000000000000000 P d3b3cabe5a094202bf2830e230a36a92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:04:54.629732 6340 raft_consensus.cc:740] T 00000000000000000000000000000000 P d3b3cabe5a094202bf2830e230a36a92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3b3cabe5a094202bf2830e230a36a92, State: Initialized, Role: FOLLOWER
I20260615 08:04:54.629771 6340 consensus_queue.cc:260] T 00000000000000000000000000000000 P d3b3cabe5a094202bf2830e230a36a92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3b3cabe5a094202bf2830e230a36a92" member_type: VOTER }
I20260615 08:04:54.629830 6340 raft_consensus.cc:399] T 00000000000000000000000000000000 P d3b3cabe5a094202bf2830e230a36a92 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260615 08:04:54.629853 6340 raft_consensus.cc:493] T 00000000000000000000000000000000 P d3b3cabe5a094202bf2830e230a36a92 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260615 08:04:54.629873 6340 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d3b3cabe5a094202bf2830e230a36a92 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:04:54.630363 6340 raft_consensus.cc:515] T 00000000000000000000000000000000 P d3b3cabe5a094202bf2830e230a36a92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3b3cabe5a094202bf2830e230a36a92" member_type: VOTER }
I20260615 08:04:54.630457 6340 leader_election.cc:304] T 00000000000000000000000000000000 P d3b3cabe5a094202bf2830e230a36a92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d3b3cabe5a094202bf2830e230a36a92; no voters:
I20260615 08:04:54.630616 6340 leader_election.cc:290] T 00000000000000000000000000000000 P d3b3cabe5a094202bf2830e230a36a92 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260615 08:04:54.630656 6343 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d3b3cabe5a094202bf2830e230a36a92 [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:04:54.630770 6340 sys_catalog.cc:565] T 00000000000000000000000000000000 P d3b3cabe5a094202bf2830e230a36a92 [sys.catalog]: configured and running, proceeding with master startup.
I20260615 08:04:54.630796 6343 raft_consensus.cc:697] T 00000000000000000000000000000000 P d3b3cabe5a094202bf2830e230a36a92 [term 1 LEADER]: Becoming Leader. State: Replica: d3b3cabe5a094202bf2830e230a36a92, State: Running, Role: LEADER
I20260615 08:04:54.630846 6343 consensus_queue.cc:237] T 00000000000000000000000000000000 P d3b3cabe5a094202bf2830e230a36a92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3b3cabe5a094202bf2830e230a36a92" member_type: VOTER }
I20260615 08:04:54.631023 6345 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3b3cabe5a094202bf2830e230a36a92 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d3b3cabe5a094202bf2830e230a36a92. Latest consensus state: current_term: 1 leader_uuid: "d3b3cabe5a094202bf2830e230a36a92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3b3cabe5a094202bf2830e230a36a92" member_type: VOTER } }
I20260615 08:04:54.631083 6345 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3b3cabe5a094202bf2830e230a36a92 [sys.catalog]: This master's current role is: LEADER
I20260615 08:04:54.631294 6347 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260615 08:04:54.631458 6347 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260615 08:04:54.631058 6344 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3b3cabe5a094202bf2830e230a36a92 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d3b3cabe5a094202bf2830e230a36a92" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3b3cabe5a094202bf2830e230a36a92" member_type: VOTER } }
I20260615 08:04:54.631623 6344 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3b3cabe5a094202bf2830e230a36a92 [sys.catalog]: This master's current role is: LEADER
I20260615 08:04:54.632055 6347 catalog_manager.cc:1382] Generated new cluster ID: effa13450f93409bb4ba1b365525ad65
I20260615 08:04:54.632100 6347 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260615 08:04:54.632228 4267 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260615 08:04:54.638652 6347 catalog_manager.cc:1405] Generated new certificate authority record
I20260615 08:04:54.639102 6347 catalog_manager.cc:1539] Loading token signing keys...
I20260615 08:04:54.651238 6347 catalog_manager.cc:6069] T 00000000000000000000000000000000 P d3b3cabe5a094202bf2830e230a36a92: Generated new TSK 0
I20260615 08:04:54.651319 6347 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260615 08:04:54.663940 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:04:54.665177 6361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:04:54.665170 6362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:04:54.665218 4267 server_base.cc:1061] running on GCE node
W20260615 08:04:54.665179 6364 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:04:54.665544 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:04:54.665576 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:04:54.665589 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510694665589 us; error 0 us; skew 500 ppm
I20260615 08:04:54.666113 4267 webserver.cc:533] Webserver started at http://127.4.42.193:33249/ using document root <none> and password file <none>
I20260615 08:04:54.666194 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:04:54.666224 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:04:54.666258 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:04:54.666476 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/ts-0-root/instance:
uuid: "7ca0afc210e643189869291f4ce28908"
format_stamp: "Formatted at 2026-06-15 08:04:54 on dist-test-slave-37n8"
I20260615 08:04:54.667307 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:04:54.667696 6369 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:54.667809 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:54.667850 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/ts-0-root
uuid: "7ca0afc210e643189869291f4ce28908"
format_stamp: "Formatted at 2026-06-15 08:04:54 on dist-test-slave-37n8"
I20260615 08:04:54.667897 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:04:54.708566 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:04:54.708735 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:04:54.708864 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:04:54.709082 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:04:54.709112 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:54.709133 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:04:54.709180 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:54.712090 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.193:40165
I20260615 08:04:54.712343 6432 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.193:40165 every 8 connection(s)
I20260615 08:04:54.712680 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:04:54.713675 6437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:04:54.713709 6438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:04:54.713873 6440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:04:54.714120 4267 server_base.cc:1061] running on GCE node
I20260615 08:04:54.714246 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:04:54.714299 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:04:54.714329 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510694714328 us; error 0 us; skew 500 ppm
I20260615 08:04:54.714926 4267 webserver.cc:533] Webserver started at http://127.4.42.194:37225/ using document root <none> and password file <none>
I20260615 08:04:54.715027 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:04:54.715076 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:04:54.715127 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:04:54.715478 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/ts-1-root/instance:
uuid: "d970408630574f449859107b27cb3c6d"
format_stamp: "Formatted at 2026-06-15 08:04:54 on dist-test-slave-37n8"
I20260615 08:04:54.716346 6433 heartbeater.cc:344] Connected to a master server at 127.4.42.254:41973
I20260615 08:04:54.716408 6433 heartbeater.cc:461] Registering TS with master...
I20260615 08:04:54.716521 6433 heartbeater.cc:507] Master 127.4.42.254:41973 requested a full tablet report, sending...
I20260615 08:04:54.716660 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260615 08:04:54.716775 6304 ts_manager.cc:194] Registered new tserver with Master: 7ca0afc210e643189869291f4ce28908 (127.4.42.193:40165)
I20260615 08:04:54.717190 6445 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:54.717340 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260615 08:04:54.717406 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/ts-1-root
uuid: "d970408630574f449859107b27cb3c6d"
format_stamp: "Formatted at 2026-06-15 08:04:54 on dist-test-slave-37n8"
I20260615 08:04:54.717451 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:04:54.717594 6304 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37990
I20260615 08:04:54.736240 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:04:54.736426 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:04:54.736578 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:04:54.736765 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:04:54.736807 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:54.736837 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:04:54.736865 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:54.739704 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.194:38369
I20260615 08:04:54.739763 6508 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.194:38369 every 8 connection(s)
I20260615 08:04:54.740100 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:04:54.741240 6512 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:04:54.741268 6513 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:04:54.741405 6515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:04:54.741488 4267 server_base.cc:1061] running on GCE node
I20260615 08:04:54.741668 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:04:54.741710 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:04:54.741727 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510694741727 us; error 0 us; skew 500 ppm
I20260615 08:04:54.742266 4267 webserver.cc:533] Webserver started at http://127.4.42.195:40363/ using document root <none> and password file <none>
I20260615 08:04:54.742357 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:04:54.742403 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:04:54.742439 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:04:54.742745 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/ts-2-root/instance:
uuid: "60b8ab9427a749dda46569b3220d0eb4"
format_stamp: "Formatted at 2026-06-15 08:04:54 on dist-test-slave-37n8"
I20260615 08:04:54.743261 6509 heartbeater.cc:344] Connected to a master server at 127.4.42.254:41973
I20260615 08:04:54.743350 6509 heartbeater.cc:461] Registering TS with master...
I20260615 08:04:54.743458 6509 heartbeater.cc:507] Master 127.4.42.254:41973 requested a full tablet report, sending...
I20260615 08:04:54.743696 6304 ts_manager.cc:194] Registered new tserver with Master: d970408630574f449859107b27cb3c6d (127.4.42.194:38369)
I20260615 08:04:54.743911 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:04:54.744102 6304 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38000
I20260615 08:04:54.744446 6520 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:54.744601 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260615 08:04:54.744658 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/ts-2-root
uuid: "60b8ab9427a749dda46569b3220d0eb4"
format_stamp: "Formatted at 2026-06-15 08:04:54 on dist-test-slave-37n8"
I20260615 08:04:54.744705 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:04:54.754863 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:04:54.755069 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:04:54.755230 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:04:54.755420 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:04:54.755467 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:54.755504 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:04:54.755530 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:54.758674 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.195:46527
I20260615 08:04:54.758740 6583 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.195:46527 every 8 connection(s)
I20260615 08:04:54.761521 6584 heartbeater.cc:344] Connected to a master server at 127.4.42.254:41973
I20260615 08:04:54.761593 6584 heartbeater.cc:461] Registering TS with master...
I20260615 08:04:54.761662 6584 heartbeater.cc:507] Master 127.4.42.254:41973 requested a full tablet report, sending...
I20260615 08:04:54.761852 6304 ts_manager.cc:194] Registered new tserver with Master: 60b8ab9427a749dda46569b3220d0eb4 (127.4.42.195:46527)
I20260615 08:04:54.762138 6304 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38014
I20260615 08:04:54.762266 4267 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003392496s
I20260615 08:04:54.766929 6304 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38028:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260615 08:04:54.767062 6304 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260615 08:04:54.771632 6548 tablet_service.cc:1511] Processing CreateTablet for tablet ff5a7614364249a8b16801645e034dc1 (DEFAULT_TABLE table=test-workload [id=297b697dc9c74c33ae1bb07136cadadc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:04:54.771759 6548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff5a7614364249a8b16801645e034dc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:04:54.772012 6473 tablet_service.cc:1511] Processing CreateTablet for tablet ff5a7614364249a8b16801645e034dc1 (DEFAULT_TABLE table=test-workload [id=297b697dc9c74c33ae1bb07136cadadc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:04:54.772071 6397 tablet_service.cc:1511] Processing CreateTablet for tablet ff5a7614364249a8b16801645e034dc1 (DEFAULT_TABLE table=test-workload [id=297b697dc9c74c33ae1bb07136cadadc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:04:54.772130 6473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff5a7614364249a8b16801645e034dc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:04:54.772153 6397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff5a7614364249a8b16801645e034dc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:04:54.773020 6599 tablet_bootstrap.cc:492] T ff5a7614364249a8b16801645e034dc1 P 60b8ab9427a749dda46569b3220d0eb4: Bootstrap starting.
I20260615 08:04:54.773473 6600 tablet_bootstrap.cc:492] T ff5a7614364249a8b16801645e034dc1 P d970408630574f449859107b27cb3c6d: Bootstrap starting.
I20260615 08:04:54.773480 6599 tablet_bootstrap.cc:654] T ff5a7614364249a8b16801645e034dc1 P 60b8ab9427a749dda46569b3220d0eb4: Neither blocks nor log segments found. Creating new log.
I20260615 08:04:54.773960 6600 tablet_bootstrap.cc:654] T ff5a7614364249a8b16801645e034dc1 P d970408630574f449859107b27cb3c6d: Neither blocks nor log segments found. Creating new log.
I20260615 08:04:54.774348 6601 tablet_bootstrap.cc:492] T ff5a7614364249a8b16801645e034dc1 P 7ca0afc210e643189869291f4ce28908: Bootstrap starting.
I20260615 08:04:54.774595 6600 tablet_bootstrap.cc:492] T ff5a7614364249a8b16801645e034dc1 P d970408630574f449859107b27cb3c6d: No bootstrap required, opened a new log
I20260615 08:04:54.774652 6600 ts_tablet_manager.cc:1403] T ff5a7614364249a8b16801645e034dc1 P d970408630574f449859107b27cb3c6d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:04:54.774844 6599 tablet_bootstrap.cc:492] T ff5a7614364249a8b16801645e034dc1 P 60b8ab9427a749dda46569b3220d0eb4: No bootstrap required, opened a new log
I20260615 08:04:54.774816 6600 raft_consensus.cc:359] T ff5a7614364249a8b16801645e034dc1 P d970408630574f449859107b27cb3c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60b8ab9427a749dda46569b3220d0eb4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 46527 } } peers { permanent_uuid: "7ca0afc210e643189869291f4ce28908" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40165 } } peers { permanent_uuid: "d970408630574f449859107b27cb3c6d" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38369 } }
I20260615 08:04:54.774856 6601 tablet_bootstrap.cc:654] T ff5a7614364249a8b16801645e034dc1 P 7ca0afc210e643189869291f4ce28908: Neither blocks nor log segments found. Creating new log.
I20260615 08:04:54.774951 6599 ts_tablet_manager.cc:1403] T ff5a7614364249a8b16801645e034dc1 P 60b8ab9427a749dda46569b3220d0eb4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260615 08:04:54.775121 6599 raft_consensus.cc:359] T ff5a7614364249a8b16801645e034dc1 P 60b8ab9427a749dda46569b3220d0eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60b8ab9427a749dda46569b3220d0eb4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 46527 } } peers { permanent_uuid: "7ca0afc210e643189869291f4ce28908" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40165 } } peers { permanent_uuid: "d970408630574f449859107b27cb3c6d" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38369 } }
I20260615 08:04:54.775188 6599 raft_consensus.cc:385] T ff5a7614364249a8b16801645e034dc1 P 60b8ab9427a749dda46569b3220d0eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:04:54.775213 6599 raft_consensus.cc:740] T ff5a7614364249a8b16801645e034dc1 P 60b8ab9427a749dda46569b3220d0eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60b8ab9427a749dda46569b3220d0eb4, State: Initialized, Role: FOLLOWER
I20260615 08:04:54.774964 6600 raft_consensus.cc:385] T ff5a7614364249a8b16801645e034dc1 P d970408630574f449859107b27cb3c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:04:54.775297 6600 raft_consensus.cc:740] T ff5a7614364249a8b16801645e034dc1 P d970408630574f449859107b27cb3c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d970408630574f449859107b27cb3c6d, State: Initialized, Role: FOLLOWER
I20260615 08:04:54.775274 6599 consensus_queue.cc:260] T ff5a7614364249a8b16801645e034dc1 P 60b8ab9427a749dda46569b3220d0eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60b8ab9427a749dda46569b3220d0eb4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 46527 } } peers { permanent_uuid: "7ca0afc210e643189869291f4ce28908" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40165 } } peers { permanent_uuid: "d970408630574f449859107b27cb3c6d" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38369 } }
I20260615 08:04:54.775372 6600 consensus_queue.cc:260] T ff5a7614364249a8b16801645e034dc1 P d970408630574f449859107b27cb3c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60b8ab9427a749dda46569b3220d0eb4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 46527 } } peers { permanent_uuid: "7ca0afc210e643189869291f4ce28908" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40165 } } peers { permanent_uuid: "d970408630574f449859107b27cb3c6d" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38369 } }
I20260615 08:04:54.775471 6599 ts_tablet_manager.cc:1434] T ff5a7614364249a8b16801645e034dc1 P 60b8ab9427a749dda46569b3220d0eb4: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260615 08:04:54.775498 6584 heartbeater.cc:499] Master 127.4.42.254:41973 was elected leader, sending a full tablet report...
I20260615 08:04:54.775547 6600 ts_tablet_manager.cc:1434] T ff5a7614364249a8b16801645e034dc1 P d970408630574f449859107b27cb3c6d: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260615 08:04:54.775701 6509 heartbeater.cc:499] Master 127.4.42.254:41973 was elected leader, sending a full tablet report...
I20260615 08:04:54.775743 6601 tablet_bootstrap.cc:492] T ff5a7614364249a8b16801645e034dc1 P 7ca0afc210e643189869291f4ce28908: No bootstrap required, opened a new log
I20260615 08:04:54.775789 6601 ts_tablet_manager.cc:1403] T ff5a7614364249a8b16801645e034dc1 P 7ca0afc210e643189869291f4ce28908: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260615 08:04:54.775933 6601 raft_consensus.cc:359] T ff5a7614364249a8b16801645e034dc1 P 7ca0afc210e643189869291f4ce28908 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60b8ab9427a749dda46569b3220d0eb4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 46527 } } peers { permanent_uuid: "7ca0afc210e643189869291f4ce28908" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40165 } } peers { permanent_uuid: "d970408630574f449859107b27cb3c6d" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38369 } }
I20260615 08:04:54.776013 6601 raft_consensus.cc:385] T ff5a7614364249a8b16801645e034dc1 P 7ca0afc210e643189869291f4ce28908 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:04:54.776038 6601 raft_consensus.cc:740] T ff5a7614364249a8b16801645e034dc1 P 7ca0afc210e643189869291f4ce28908 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ca0afc210e643189869291f4ce28908, State: Initialized, Role: FOLLOWER
I20260615 08:04:54.776104 6601 consensus_queue.cc:260] T ff5a7614364249a8b16801645e034dc1 P 7ca0afc210e643189869291f4ce28908 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60b8ab9427a749dda46569b3220d0eb4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 46527 } } peers { permanent_uuid: "7ca0afc210e643189869291f4ce28908" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40165 } } peers { permanent_uuid: "d970408630574f449859107b27cb3c6d" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38369 } }
I20260615 08:04:54.776306 6601 ts_tablet_manager.cc:1434] T ff5a7614364249a8b16801645e034dc1 P 7ca0afc210e643189869291f4ce28908: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260615 08:04:54.776336 6433 heartbeater.cc:499] Master 127.4.42.254:41973 was elected leader, sending a full tablet report...
I20260615 08:04:54.787237 6607 raft_consensus.cc:493] T ff5a7614364249a8b16801645e034dc1 P 7ca0afc210e643189869291f4ce28908 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260615 08:04:54.787307 6607 raft_consensus.cc:515] T ff5a7614364249a8b16801645e034dc1 P 7ca0afc210e643189869291f4ce28908 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60b8ab9427a749dda46569b3220d0eb4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 46527 } } peers { permanent_uuid: "7ca0afc210e643189869291f4ce28908" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40165 } } peers { permanent_uuid: "d970408630574f449859107b27cb3c6d" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38369 } }
I20260615 08:04:54.787470 6607 leader_election.cc:290] T ff5a7614364249a8b16801645e034dc1 P 7ca0afc210e643189869291f4ce28908 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60b8ab9427a749dda46569b3220d0eb4 (127.4.42.195:46527), d970408630574f449859107b27cb3c6d (127.4.42.194:38369)
I20260615 08:04:54.789899 6558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a7614364249a8b16801645e034dc1" candidate_uuid: "7ca0afc210e643189869291f4ce28908" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60b8ab9427a749dda46569b3220d0eb4" is_pre_election: true
I20260615 08:04:54.789997 6558 raft_consensus.cc:2468] T ff5a7614364249a8b16801645e034dc1 P 60b8ab9427a749dda46569b3220d0eb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ca0afc210e643189869291f4ce28908 in term 0.
I20260615 08:04:54.790158 6373 leader_election.cc:304] T ff5a7614364249a8b16801645e034dc1 P 7ca0afc210e643189869291f4ce28908 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60b8ab9427a749dda46569b3220d0eb4, 7ca0afc210e643189869291f4ce28908; no voters:
I20260615 08:04:54.790259 6607 raft_consensus.cc:2804] T ff5a7614364249a8b16801645e034dc1 P 7ca0afc210e643189869291f4ce28908 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260615 08:04:54.790289 6483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a7614364249a8b16801645e034dc1" candidate_uuid: "7ca0afc210e643189869291f4ce28908" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d970408630574f449859107b27cb3c6d" is_pre_election: true
I20260615 08:04:54.790299 6607 raft_consensus.cc:493] T ff5a7614364249a8b16801645e034dc1 P 7ca0afc210e643189869291f4ce28908 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:04:54.790370 6607 raft_consensus.cc:3060] T ff5a7614364249a8b16801645e034dc1 P 7ca0afc210e643189869291f4ce28908 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:04:54.790373 6483 raft_consensus.cc:2468] T ff5a7614364249a8b16801645e034dc1 P d970408630574f449859107b27cb3c6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ca0afc210e643189869291f4ce28908 in term 0.
I20260615 08:04:54.791006 6607 raft_consensus.cc:515] T ff5a7614364249a8b16801645e034dc1 P 7ca0afc210e643189869291f4ce28908 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60b8ab9427a749dda46569b3220d0eb4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 46527 } } peers { permanent_uuid: "7ca0afc210e643189869291f4ce28908" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40165 } } peers { permanent_uuid: "d970408630574f449859107b27cb3c6d" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38369 } }
I20260615 08:04:54.791134 6607 leader_election.cc:290] T ff5a7614364249a8b16801645e034dc1 P 7ca0afc210e643189869291f4ce28908 [CANDIDATE]: Term 1 election: Requested vote from peers 60b8ab9427a749dda46569b3220d0eb4 (127.4.42.195:46527), d970408630574f449859107b27cb3c6d (127.4.42.194:38369)
I20260615 08:04:54.791292 6483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a7614364249a8b16801645e034dc1" candidate_uuid: "7ca0afc210e643189869291f4ce28908" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d970408630574f449859107b27cb3c6d"
I20260615 08:04:54.791297 6558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff5a7614364249a8b16801645e034dc1" candidate_uuid: "7ca0afc210e643189869291f4ce28908" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60b8ab9427a749dda46569b3220d0eb4"
I20260615 08:04:54.791384 6483 raft_consensus.cc:3060] T ff5a7614364249a8b16801645e034dc1 P d970408630574f449859107b27cb3c6d [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:04:54.791405 6558 raft_consensus.cc:3060] T ff5a7614364249a8b16801645e034dc1 P 60b8ab9427a749dda46569b3220d0eb4 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:04:54.791996 6558 raft_consensus.cc:2468] T ff5a7614364249a8b16801645e034dc1 P 60b8ab9427a749dda46569b3220d0eb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ca0afc210e643189869291f4ce28908 in term 1.
I20260615 08:04:54.792099 6483 raft_consensus.cc:2468] T ff5a7614364249a8b16801645e034dc1 P d970408630574f449859107b27cb3c6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ca0afc210e643189869291f4ce28908 in term 1.
I20260615 08:04:54.792143 6373 leader_election.cc:304] T ff5a7614364249a8b16801645e034dc1 P 7ca0afc210e643189869291f4ce28908 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60b8ab9427a749dda46569b3220d0eb4, 7ca0afc210e643189869291f4ce28908; no voters:
I20260615 08:04:54.792204 6607 raft_consensus.cc:2804] T ff5a7614364249a8b16801645e034dc1 P 7ca0afc210e643189869291f4ce28908 [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:04:54.792331 6607 raft_consensus.cc:697] T ff5a7614364249a8b16801645e034dc1 P 7ca0afc210e643189869291f4ce28908 [term 1 LEADER]: Becoming Leader. State: Replica: 7ca0afc210e643189869291f4ce28908, State: Running, Role: LEADER
I20260615 08:04:54.792392 6607 consensus_queue.cc:237] T ff5a7614364249a8b16801645e034dc1 P 7ca0afc210e643189869291f4ce28908 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60b8ab9427a749dda46569b3220d0eb4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 46527 } } peers { permanent_uuid: "7ca0afc210e643189869291f4ce28908" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40165 } } peers { permanent_uuid: "d970408630574f449859107b27cb3c6d" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38369 } }
I20260615 08:04:54.792920 6302 catalog_manager.cc:5696] T ff5a7614364249a8b16801645e034dc1 P 7ca0afc210e643189869291f4ce28908 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ca0afc210e643189869291f4ce28908 (127.4.42.193). New cstate: current_term: 1 leader_uuid: "7ca0afc210e643189869291f4ce28908" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60b8ab9427a749dda46569b3220d0eb4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 46527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ca0afc210e643189869291f4ce28908" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40165 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d970408630574f449859107b27cb3c6d" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38369 } health_report { overall_health: UNKNOWN } } }
I20260615 08:04:54.801492 6558 raft_consensus.cc:1275] T ff5a7614364249a8b16801645e034dc1 P 60b8ab9427a749dda46569b3220d0eb4 [term 1 FOLLOWER]: Refusing update from remote peer 7ca0afc210e643189869291f4ce28908: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:04:54.801497 6483 raft_consensus.cc:1275] T ff5a7614364249a8b16801645e034dc1 P d970408630574f449859107b27cb3c6d [term 1 FOLLOWER]: Refusing update from remote peer 7ca0afc210e643189869291f4ce28908: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:04:54.801736 6609 consensus_queue.cc:1048] T ff5a7614364249a8b16801645e034dc1 P 7ca0afc210e643189869291f4ce28908 [LEADER]: Connected to new peer: Peer: permanent_uuid: "60b8ab9427a749dda46569b3220d0eb4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 46527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:04:54.801852 6607 consensus_queue.cc:1048] T ff5a7614364249a8b16801645e034dc1 P 7ca0afc210e643189869291f4ce28908 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d970408630574f449859107b27cb3c6d" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260615 08:05:04.809314 6616 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40616: Illegal state: Transaction hasn't been successfully started
W20260615 08:05:04.809767 6616 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:40616: Illegal state: Transaction metadata for transaction 1 does not exist
I20260615 08:05:04.811054 4267 tablet_server.cc:179] TabletServer@127.4.42.193:0 shutting down...
I20260615 08:05:04.813577 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:05:04.813702 4267 tablet_replica.cc:333] T ff5a7614364249a8b16801645e034dc1 P 7ca0afc210e643189869291f4ce28908: stopping tablet replica
I20260615 08:05:04.813755 4267 raft_consensus.cc:2243] T ff5a7614364249a8b16801645e034dc1 P 7ca0afc210e643189869291f4ce28908 [term 1 LEADER]: Raft consensus shutting down.
I20260615 08:05:04.813807 4267 raft_consensus.cc:2272] T ff5a7614364249a8b16801645e034dc1 P 7ca0afc210e643189869291f4ce28908 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:05:04.829785 4267 tablet_server.cc:196] TabletServer@127.4.42.193:0 shutdown complete.
I20260615 08:05:04.830754 4267 tablet_server.cc:179] TabletServer@127.4.42.194:0 shutting down...
I20260615 08:05:04.833992 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:05:04.834105 4267 tablet_replica.cc:333] T ff5a7614364249a8b16801645e034dc1 P d970408630574f449859107b27cb3c6d: stopping tablet replica
I20260615 08:05:04.834164 4267 raft_consensus.cc:2243] T ff5a7614364249a8b16801645e034dc1 P d970408630574f449859107b27cb3c6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260615 08:05:04.834208 4267 raft_consensus.cc:2272] T ff5a7614364249a8b16801645e034dc1 P d970408630574f449859107b27cb3c6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:05:04.847709 4267 tablet_server.cc:196] TabletServer@127.4.42.194:0 shutdown complete.
I20260615 08:05:04.848563 4267 tablet_server.cc:179] TabletServer@127.4.42.195:0 shutting down...
I20260615 08:05:04.851960 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:05:04.852056 4267 tablet_replica.cc:333] T ff5a7614364249a8b16801645e034dc1 P 60b8ab9427a749dda46569b3220d0eb4: stopping tablet replica
I20260615 08:05:04.852111 4267 raft_consensus.cc:2243] T ff5a7614364249a8b16801645e034dc1 P 60b8ab9427a749dda46569b3220d0eb4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260615 08:05:04.852167 4267 raft_consensus.cc:2272] T ff5a7614364249a8b16801645e034dc1 P 60b8ab9427a749dda46569b3220d0eb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:05:04.865154 4267 tablet_server.cc:196] TabletServer@127.4.42.195:0 shutdown complete.
I20260615 08:05:04.865959 4267 master.cc:562] Master@127.4.42.254:41973 shutting down...
I20260615 08:05:04.868283 4267 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d3b3cabe5a094202bf2830e230a36a92 [term 1 LEADER]: Raft consensus shutting down.
I20260615 08:05:04.868338 4267 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d3b3cabe5a094202bf2830e230a36a92 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:05:04.868355 4267 tablet_replica.cc:333] T 00000000000000000000000000000000 P d3b3cabe5a094202bf2830e230a36a92: stopping tablet replica
I20260615 08:05:04.879827 4267 master.cc:584] Master@127.4.42.254:41973 shutdown complete.
[ OK ] TxnParticipantITest.TestProxyErrorWhenNotBegun (10321 ms)
[ RUN ] TxnParticipantITest.TestProxyIllegalStatesInCommitSequence
I20260615 08:05:04.898854 4267 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.42.254:36683
I20260615 08:05:04.898994 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:05:04.900701 6646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:05:04.900712 4267 server_base.cc:1061] running on GCE node
W20260615 08:05:04.900787 6647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:05:04.900723 6649 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:05:04.900954 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:05:04.901003 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:05:04.901017 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510704901018 us; error 0 us; skew 500 ppm
I20260615 08:05:04.901598 4267 webserver.cc:533] Webserver started at http://127.4.42.254:35453/ using document root <none> and password file <none>
I20260615 08:05:04.901686 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:05:04.901731 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:05:04.901777 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:05:04.902042 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1781510637089012-4267-0/minicluster-data/master-0-root/instance:
uuid: "8a63788d48454a2aa5e5bce44020c560"
format_stamp: "Formatted at 2026-06-15 08:05:04 on dist-test-slave-37n8"
I20260615 08:05:04.903225 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:05:04.903803 6654 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:04.903929 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260615 08:05:04.903996 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1781510637089012-4267-0/minicluster-data/master-0-root
uuid: "8a63788d48454a2aa5e5bce44020c560"
format_stamp: "Formatted at 2026-06-15 08:05:04 on dist-test-slave-37n8"
I20260615 08:05:04.904034 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1781510637089012-4267-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1781510637089012-4267-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1781510637089012-4267-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:05:04.938012 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:05:04.938190 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:05:04.940707 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.254:36683
I20260615 08:05:04.948143 6706 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.254:36683 every 8 connection(s)
I20260615 08:05:04.948302 6707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:05:04.949282 6707 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a63788d48454a2aa5e5bce44020c560: Bootstrap starting.
I20260615 08:05:04.949534 6707 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a63788d48454a2aa5e5bce44020c560: Neither blocks nor log segments found. Creating new log.
I20260615 08:05:04.949988 6707 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a63788d48454a2aa5e5bce44020c560: No bootstrap required, opened a new log
I20260615 08:05:04.950091 6707 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8a63788d48454a2aa5e5bce44020c560 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a63788d48454a2aa5e5bce44020c560" member_type: VOTER }
I20260615 08:05:04.950135 6707 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8a63788d48454a2aa5e5bce44020c560 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:05:04.950148 6707 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8a63788d48454a2aa5e5bce44020c560 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a63788d48454a2aa5e5bce44020c560, State: Initialized, Role: FOLLOWER
I20260615 08:05:04.950214 6707 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a63788d48454a2aa5e5bce44020c560 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a63788d48454a2aa5e5bce44020c560" member_type: VOTER }
I20260615 08:05:04.950255 6707 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8a63788d48454a2aa5e5bce44020c560 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260615 08:05:04.950274 6707 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a63788d48454a2aa5e5bce44020c560 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260615 08:05:04.950299 6707 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8a63788d48454a2aa5e5bce44020c560 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:05:04.950822 6707 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a63788d48454a2aa5e5bce44020c560 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a63788d48454a2aa5e5bce44020c560" member_type: VOTER }
I20260615 08:05:04.950874 6707 leader_election.cc:304] T 00000000000000000000000000000000 P 8a63788d48454a2aa5e5bce44020c560 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a63788d48454a2aa5e5bce44020c560; no voters:
I20260615 08:05:04.950955 6707 leader_election.cc:290] T 00000000000000000000000000000000 P 8a63788d48454a2aa5e5bce44020c560 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260615 08:05:04.951010 6710 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8a63788d48454a2aa5e5bce44020c560 [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:05:04.951105 6707 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8a63788d48454a2aa5e5bce44020c560 [sys.catalog]: configured and running, proceeding with master startup.
I20260615 08:05:04.951170 6710 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8a63788d48454a2aa5e5bce44020c560 [term 1 LEADER]: Becoming Leader. State: Replica: 8a63788d48454a2aa5e5bce44020c560, State: Running, Role: LEADER
I20260615 08:05:04.951223 6710 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a63788d48454a2aa5e5bce44020c560 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a63788d48454a2aa5e5bce44020c560" member_type: VOTER }
I20260615 08:05:04.951431 6711 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a63788d48454a2aa5e5bce44020c560 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8a63788d48454a2aa5e5bce44020c560" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a63788d48454a2aa5e5bce44020c560" member_type: VOTER } }
I20260615 08:05:04.951439 6712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a63788d48454a2aa5e5bce44020c560 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a63788d48454a2aa5e5bce44020c560. Latest consensus state: current_term: 1 leader_uuid: "8a63788d48454a2aa5e5bce44020c560" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a63788d48454a2aa5e5bce44020c560" member_type: VOTER } }
I20260615 08:05:04.951499 6711 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a63788d48454a2aa5e5bce44020c560 [sys.catalog]: This master's current role is: LEADER
I20260615 08:05:04.951510 6712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a63788d48454a2aa5e5bce44020c560 [sys.catalog]: This master's current role is: LEADER
I20260615 08:05:04.951766 6716 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260615 08:05:04.951924 6716 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260615 08:05:04.952478 4267 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260615 08:05:04.952502 6716 catalog_manager.cc:1382] Generated new cluster ID: 68dde2cd85b242aca40810721e1f4061
I20260615 08:05:04.952553 6716 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260615 08:05:04.965194 6716 catalog_manager.cc:1405] Generated new certificate authority record
I20260615 08:05:04.965559 6716 catalog_manager.cc:1539] Loading token signing keys...
I20260615 08:05:04.973197 6716 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 8a63788d48454a2aa5e5bce44020c560: Generated new TSK 0
I20260615 08:05:04.973260 6716 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260615 08:05:04.984220 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:05:04.985491 6729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:05:04.985572 4267 server_base.cc:1061] running on GCE node
W20260615 08:05:04.985630 6728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:05:04.985572 6731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:05:04.985782 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:05:04.985818 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:05:04.985838 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510704985839 us; error 0 us; skew 500 ppm
I20260615 08:05:04.986455 4267 webserver.cc:533] Webserver started at http://127.4.42.193:34307/ using document root <none> and password file <none>
I20260615 08:05:04.986567 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:05:04.986611 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:05:04.986663 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:05:04.986901 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1781510637089012-4267-0/minicluster-data/ts-0-root/instance:
uuid: "7926b1f56ccb412fbe53f20b4a9d3749"
format_stamp: "Formatted at 2026-06-15 08:05:04 on dist-test-slave-37n8"
I20260615 08:05:04.987736 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:05:04.988232 6736 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:04.988358 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:04.988421 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1781510637089012-4267-0/minicluster-data/ts-0-root
uuid: "7926b1f56ccb412fbe53f20b4a9d3749"
format_stamp: "Formatted at 2026-06-15 08:05:04 on dist-test-slave-37n8"
I20260615 08:05:04.988466 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1781510637089012-4267-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1781510637089012-4267-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1781510637089012-4267-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:05:05.000622 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:05:05.000801 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:05:05.000950 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:05:05.001142 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:05:05.001184 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:05.001221 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:05:05.001246 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:05.004189 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.193:41753
I20260615 08:05:05.004549 6799 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.193:41753 every 8 connection(s)
I20260615 08:05:05.004755 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:05:05.005740 6804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:05:05.005769 6807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:05:05.005952 6805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:05:05.006547 4267 server_base.cc:1061] running on GCE node
I20260615 08:05:05.006701 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:05:05.006743 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:05:05.006764 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510705006764 us; error 0 us; skew 500 ppm
I20260615 08:05:05.007341 4267 webserver.cc:533] Webserver started at http://127.4.42.194:46205/ using document root <none> and password file <none>
I20260615 08:05:05.007429 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:05:05.007477 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:05:05.007532 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:05:05.007750 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1781510637089012-4267-0/minicluster-data/ts-1-root/instance:
uuid: "bda7c2ee9d29423ea6354799a38b0be1"
format_stamp: "Formatted at 2026-06-15 08:05:05 on dist-test-slave-37n8"
I20260615 08:05:05.008126 6800 heartbeater.cc:344] Connected to a master server at 127.4.42.254:36683
I20260615 08:05:05.008194 6800 heartbeater.cc:461] Registering TS with master...
I20260615 08:05:05.008304 6800 heartbeater.cc:507] Master 127.4.42.254:36683 requested a full tablet report, sending...
I20260615 08:05:05.008514 6671 ts_manager.cc:194] Registered new tserver with Master: 7926b1f56ccb412fbe53f20b4a9d3749 (127.4.42.193:41753)
I20260615 08:05:05.008848 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:05:05.009274 6671 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45372
I20260615 08:05:05.009313 6812 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:05.009478 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:05.009548 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1781510637089012-4267-0/minicluster-data/ts-1-root
uuid: "bda7c2ee9d29423ea6354799a38b0be1"
format_stamp: "Formatted at 2026-06-15 08:05:05 on dist-test-slave-37n8"
I20260615 08:05:05.009614 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1781510637089012-4267-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1781510637089012-4267-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1781510637089012-4267-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:05:05.024312 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:05:05.024528 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:05:05.024683 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:05:05.024889 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:05:05.024946 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:05.024976 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:05:05.025000 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:05.028091 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.194:35967
I20260615 08:05:05.028640 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260615 08:05:05.028971 6875 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.194:35967 every 8 connection(s)
W20260615 08:05:05.029965 6879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:05:05.029964 6878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:05:05.030191 4267 server_base.cc:1061] running on GCE node
W20260615 08:05:05.030272 6882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:05:05.030471 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:05:05.030551 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:05:05.030575 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510705030574 us; error 0 us; skew 500 ppm
I20260615 08:05:05.031167 4267 webserver.cc:533] Webserver started at http://127.4.42.195:41579/ using document root <none> and password file <none>
I20260615 08:05:05.031267 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:05:05.031314 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:05:05.031361 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:05:05.031658 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1781510637089012-4267-0/minicluster-data/ts-2-root/instance:
uuid: "1fc1a983ef6b4d48bafee36b4dbfe17c"
format_stamp: "Formatted at 2026-06-15 08:05:05 on dist-test-slave-37n8"
I20260615 08:05:05.032541 6876 heartbeater.cc:344] Connected to a master server at 127.4.42.254:36683
I20260615 08:05:05.032598 6876 heartbeater.cc:461] Registering TS with master...
I20260615 08:05:05.032629 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:05:05.032706 6876 heartbeater.cc:507] Master 127.4.42.254:36683 requested a full tablet report, sending...
I20260615 08:05:05.032933 6671 ts_manager.cc:194] Registered new tserver with Master: bda7c2ee9d29423ea6354799a38b0be1 (127.4.42.194:35967)
I20260615 08:05:05.033275 6671 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45382
I20260615 08:05:05.033560 6887 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:05.033732 4267 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:05:05.033798 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1781510637089012-4267-0/minicluster-data/ts-2-root
uuid: "1fc1a983ef6b4d48bafee36b4dbfe17c"
format_stamp: "Formatted at 2026-06-15 08:05:05 on dist-test-slave-37n8"
I20260615 08:05:05.033845 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1781510637089012-4267-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1781510637089012-4267-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInCommitSequence.1781510637089012-4267-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:05:05.041590 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:05:05.041813 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:05:05.041975 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:05:05.042196 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:05:05.042239 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:05.042277 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:05:05.042303 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:05.045459 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.195:41951
I20260615 08:05:05.045518 6950 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.195:41951 every 8 connection(s)
I20260615 08:05:05.048386 6951 heartbeater.cc:344] Connected to a master server at 127.4.42.254:36683
I20260615 08:05:05.048448 6951 heartbeater.cc:461] Registering TS with master...
I20260615 08:05:05.048553 6951 heartbeater.cc:507] Master 127.4.42.254:36683 requested a full tablet report, sending...
I20260615 08:05:05.048799 6671 ts_manager.cc:194] Registered new tserver with Master: 1fc1a983ef6b4d48bafee36b4dbfe17c (127.4.42.195:41951)
I20260615 08:05:05.048957 4267 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003295598s
I20260615 08:05:05.049221 6671 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45392
I20260615 08:05:05.053730 6671 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45406:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260615 08:05:05.053879 6671 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260615 08:05:05.058364 6840 tablet_service.cc:1511] Processing CreateTablet for tablet 7ddd387b447d4cf48dd7f21a57397363 (DEFAULT_TABLE table=test-workload [id=8356a71555bc484a8b4ce1257437f771]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:05:05.058482 6840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ddd387b447d4cf48dd7f21a57397363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:05:05.059146 6915 tablet_service.cc:1511] Processing CreateTablet for tablet 7ddd387b447d4cf48dd7f21a57397363 (DEFAULT_TABLE table=test-workload [id=8356a71555bc484a8b4ce1257437f771]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:05:05.059290 6915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ddd387b447d4cf48dd7f21a57397363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:05:05.059834 6966 tablet_bootstrap.cc:492] T 7ddd387b447d4cf48dd7f21a57397363 P bda7c2ee9d29423ea6354799a38b0be1: Bootstrap starting.
I20260615 08:05:05.059873 6763 tablet_service.cc:1511] Processing CreateTablet for tablet 7ddd387b447d4cf48dd7f21a57397363 (DEFAULT_TABLE table=test-workload [id=8356a71555bc484a8b4ce1257437f771]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:05:05.059952 6763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ddd387b447d4cf48dd7f21a57397363. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:05:05.060298 6966 tablet_bootstrap.cc:654] T 7ddd387b447d4cf48dd7f21a57397363 P bda7c2ee9d29423ea6354799a38b0be1: Neither blocks nor log segments found. Creating new log.
I20260615 08:05:05.061153 6969 tablet_bootstrap.cc:492] T 7ddd387b447d4cf48dd7f21a57397363 P 7926b1f56ccb412fbe53f20b4a9d3749: Bootstrap starting.
I20260615 08:05:05.061342 6967 tablet_bootstrap.cc:492] T 7ddd387b447d4cf48dd7f21a57397363 P 1fc1a983ef6b4d48bafee36b4dbfe17c: Bootstrap starting.
I20260615 08:05:05.061642 6969 tablet_bootstrap.cc:654] T 7ddd387b447d4cf48dd7f21a57397363 P 7926b1f56ccb412fbe53f20b4a9d3749: Neither blocks nor log segments found. Creating new log.
I20260615 08:05:05.061709 6967 tablet_bootstrap.cc:654] T 7ddd387b447d4cf48dd7f21a57397363 P 1fc1a983ef6b4d48bafee36b4dbfe17c: Neither blocks nor log segments found. Creating new log.
I20260615 08:05:05.062211 6966 tablet_bootstrap.cc:492] T 7ddd387b447d4cf48dd7f21a57397363 P bda7c2ee9d29423ea6354799a38b0be1: No bootstrap required, opened a new log
I20260615 08:05:05.062284 6966 ts_tablet_manager.cc:1403] T 7ddd387b447d4cf48dd7f21a57397363 P bda7c2ee9d29423ea6354799a38b0be1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260615 08:05:05.062223 6967 tablet_bootstrap.cc:492] T 7ddd387b447d4cf48dd7f21a57397363 P 1fc1a983ef6b4d48bafee36b4dbfe17c: No bootstrap required, opened a new log
I20260615 08:05:05.062361 6967 ts_tablet_manager.cc:1403] T 7ddd387b447d4cf48dd7f21a57397363 P 1fc1a983ef6b4d48bafee36b4dbfe17c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:05:05.062445 6966 raft_consensus.cc:359] T 7ddd387b447d4cf48dd7f21a57397363 P bda7c2ee9d29423ea6354799a38b0be1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc1a983ef6b4d48bafee36b4dbfe17c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41951 } } peers { permanent_uuid: "bda7c2ee9d29423ea6354799a38b0be1" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 35967 } } peers { permanent_uuid: "7926b1f56ccb412fbe53f20b4a9d3749" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41753 } }
I20260615 08:05:05.062588 6966 raft_consensus.cc:385] T 7ddd387b447d4cf48dd7f21a57397363 P bda7c2ee9d29423ea6354799a38b0be1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:05:05.062527 6967 raft_consensus.cc:359] T 7ddd387b447d4cf48dd7f21a57397363 P 1fc1a983ef6b4d48bafee36b4dbfe17c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc1a983ef6b4d48bafee36b4dbfe17c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41951 } } peers { permanent_uuid: "bda7c2ee9d29423ea6354799a38b0be1" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 35967 } } peers { permanent_uuid: "7926b1f56ccb412fbe53f20b4a9d3749" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41753 } }
I20260615 08:05:05.062623 6966 raft_consensus.cc:740] T 7ddd387b447d4cf48dd7f21a57397363 P bda7c2ee9d29423ea6354799a38b0be1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda7c2ee9d29423ea6354799a38b0be1, State: Initialized, Role: FOLLOWER
I20260615 08:05:05.062657 6967 raft_consensus.cc:385] T 7ddd387b447d4cf48dd7f21a57397363 P 1fc1a983ef6b4d48bafee36b4dbfe17c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:05:05.062690 6967 raft_consensus.cc:740] T 7ddd387b447d4cf48dd7f21a57397363 P 1fc1a983ef6b4d48bafee36b4dbfe17c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fc1a983ef6b4d48bafee36b4dbfe17c, State: Initialized, Role: FOLLOWER
I20260615 08:05:05.062700 6966 consensus_queue.cc:260] T 7ddd387b447d4cf48dd7f21a57397363 P bda7c2ee9d29423ea6354799a38b0be1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc1a983ef6b4d48bafee36b4dbfe17c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41951 } } peers { permanent_uuid: "bda7c2ee9d29423ea6354799a38b0be1" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 35967 } } peers { permanent_uuid: "7926b1f56ccb412fbe53f20b4a9d3749" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41753 } }
I20260615 08:05:05.062762 6967 consensus_queue.cc:260] T 7ddd387b447d4cf48dd7f21a57397363 P 1fc1a983ef6b4d48bafee36b4dbfe17c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc1a983ef6b4d48bafee36b4dbfe17c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41951 } } peers { permanent_uuid: "bda7c2ee9d29423ea6354799a38b0be1" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 35967 } } peers { permanent_uuid: "7926b1f56ccb412fbe53f20b4a9d3749" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41753 } }
I20260615 08:05:05.062870 6966 ts_tablet_manager.cc:1434] T 7ddd387b447d4cf48dd7f21a57397363 P bda7c2ee9d29423ea6354799a38b0be1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:05:05.062897 6876 heartbeater.cc:499] Master 127.4.42.254:36683 was elected leader, sending a full tablet report...
I20260615 08:05:05.062915 6967 ts_tablet_manager.cc:1434] T 7ddd387b447d4cf48dd7f21a57397363 P 1fc1a983ef6b4d48bafee36b4dbfe17c: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:05:05.062985 6951 heartbeater.cc:499] Master 127.4.42.254:36683 was elected leader, sending a full tablet report...
I20260615 08:05:05.063091 6969 tablet_bootstrap.cc:492] T 7ddd387b447d4cf48dd7f21a57397363 P 7926b1f56ccb412fbe53f20b4a9d3749: No bootstrap required, opened a new log
I20260615 08:05:05.063247 6969 ts_tablet_manager.cc:1403] T 7ddd387b447d4cf48dd7f21a57397363 P 7926b1f56ccb412fbe53f20b4a9d3749: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260615 08:05:05.063397 6969 raft_consensus.cc:359] T 7ddd387b447d4cf48dd7f21a57397363 P 7926b1f56ccb412fbe53f20b4a9d3749 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc1a983ef6b4d48bafee36b4dbfe17c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41951 } } peers { permanent_uuid: "bda7c2ee9d29423ea6354799a38b0be1" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 35967 } } peers { permanent_uuid: "7926b1f56ccb412fbe53f20b4a9d3749" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41753 } }
I20260615 08:05:05.063465 6969 raft_consensus.cc:385] T 7ddd387b447d4cf48dd7f21a57397363 P 7926b1f56ccb412fbe53f20b4a9d3749 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:05:05.063490 6969 raft_consensus.cc:740] T 7ddd387b447d4cf48dd7f21a57397363 P 7926b1f56ccb412fbe53f20b4a9d3749 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7926b1f56ccb412fbe53f20b4a9d3749, State: Initialized, Role: FOLLOWER
I20260615 08:05:05.063541 6969 consensus_queue.cc:260] T 7ddd387b447d4cf48dd7f21a57397363 P 7926b1f56ccb412fbe53f20b4a9d3749 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc1a983ef6b4d48bafee36b4dbfe17c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41951 } } peers { permanent_uuid: "bda7c2ee9d29423ea6354799a38b0be1" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 35967 } } peers { permanent_uuid: "7926b1f56ccb412fbe53f20b4a9d3749" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41753 } }
I20260615 08:05:05.063861 6969 ts_tablet_manager.cc:1434] T 7ddd387b447d4cf48dd7f21a57397363 P 7926b1f56ccb412fbe53f20b4a9d3749: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260615 08:05:05.063907 6800 heartbeater.cc:499] Master 127.4.42.254:36683 was elected leader, sending a full tablet report...
I20260615 08:05:05.074707 6974 raft_consensus.cc:493] T 7ddd387b447d4cf48dd7f21a57397363 P 7926b1f56ccb412fbe53f20b4a9d3749 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260615 08:05:05.074779 6974 raft_consensus.cc:515] T 7ddd387b447d4cf48dd7f21a57397363 P 7926b1f56ccb412fbe53f20b4a9d3749 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc1a983ef6b4d48bafee36b4dbfe17c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41951 } } peers { permanent_uuid: "bda7c2ee9d29423ea6354799a38b0be1" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 35967 } } peers { permanent_uuid: "7926b1f56ccb412fbe53f20b4a9d3749" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41753 } }
I20260615 08:05:05.074934 6974 leader_election.cc:290] T 7ddd387b447d4cf48dd7f21a57397363 P 7926b1f56ccb412fbe53f20b4a9d3749 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fc1a983ef6b4d48bafee36b4dbfe17c (127.4.42.195:41951), bda7c2ee9d29423ea6354799a38b0be1 (127.4.42.194:35967)
I20260615 08:05:05.077536 6925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddd387b447d4cf48dd7f21a57397363" candidate_uuid: "7926b1f56ccb412fbe53f20b4a9d3749" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fc1a983ef6b4d48bafee36b4dbfe17c" is_pre_election: true
I20260615 08:05:05.077621 6925 raft_consensus.cc:2468] T 7ddd387b447d4cf48dd7f21a57397363 P 1fc1a983ef6b4d48bafee36b4dbfe17c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7926b1f56ccb412fbe53f20b4a9d3749 in term 0.
I20260615 08:05:05.077652 6850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddd387b447d4cf48dd7f21a57397363" candidate_uuid: "7926b1f56ccb412fbe53f20b4a9d3749" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda7c2ee9d29423ea6354799a38b0be1" is_pre_election: true
I20260615 08:05:05.077710 6850 raft_consensus.cc:2468] T 7ddd387b447d4cf48dd7f21a57397363 P bda7c2ee9d29423ea6354799a38b0be1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7926b1f56ccb412fbe53f20b4a9d3749 in term 0.
I20260615 08:05:05.077785 6739 leader_election.cc:304] T 7ddd387b447d4cf48dd7f21a57397363 P 7926b1f56ccb412fbe53f20b4a9d3749 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fc1a983ef6b4d48bafee36b4dbfe17c, 7926b1f56ccb412fbe53f20b4a9d3749; no voters:
I20260615 08:05:05.077896 6974 raft_consensus.cc:2804] T 7ddd387b447d4cf48dd7f21a57397363 P 7926b1f56ccb412fbe53f20b4a9d3749 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260615 08:05:05.077941 6974 raft_consensus.cc:493] T 7ddd387b447d4cf48dd7f21a57397363 P 7926b1f56ccb412fbe53f20b4a9d3749 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:05:05.077972 6974 raft_consensus.cc:3060] T 7ddd387b447d4cf48dd7f21a57397363 P 7926b1f56ccb412fbe53f20b4a9d3749 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:05:05.078590 6974 raft_consensus.cc:515] T 7ddd387b447d4cf48dd7f21a57397363 P 7926b1f56ccb412fbe53f20b4a9d3749 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc1a983ef6b4d48bafee36b4dbfe17c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41951 } } peers { permanent_uuid: "bda7c2ee9d29423ea6354799a38b0be1" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 35967 } } peers { permanent_uuid: "7926b1f56ccb412fbe53f20b4a9d3749" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41753 } }
I20260615 08:05:05.078747 6974 leader_election.cc:290] T 7ddd387b447d4cf48dd7f21a57397363 P 7926b1f56ccb412fbe53f20b4a9d3749 [CANDIDATE]: Term 1 election: Requested vote from peers 1fc1a983ef6b4d48bafee36b4dbfe17c (127.4.42.195:41951), bda7c2ee9d29423ea6354799a38b0be1 (127.4.42.194:35967)
I20260615 08:05:05.078872 6850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddd387b447d4cf48dd7f21a57397363" candidate_uuid: "7926b1f56ccb412fbe53f20b4a9d3749" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bda7c2ee9d29423ea6354799a38b0be1"
I20260615 08:05:05.078939 6850 raft_consensus.cc:3060] T 7ddd387b447d4cf48dd7f21a57397363 P bda7c2ee9d29423ea6354799a38b0be1 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:05:05.078877 6925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddd387b447d4cf48dd7f21a57397363" candidate_uuid: "7926b1f56ccb412fbe53f20b4a9d3749" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fc1a983ef6b4d48bafee36b4dbfe17c"
I20260615 08:05:05.078977 6925 raft_consensus.cc:3060] T 7ddd387b447d4cf48dd7f21a57397363 P 1fc1a983ef6b4d48bafee36b4dbfe17c [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:05:05.079806 6850 raft_consensus.cc:2468] T 7ddd387b447d4cf48dd7f21a57397363 P bda7c2ee9d29423ea6354799a38b0be1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7926b1f56ccb412fbe53f20b4a9d3749 in term 1.
I20260615 08:05:05.079895 6925 raft_consensus.cc:2468] T 7ddd387b447d4cf48dd7f21a57397363 P 1fc1a983ef6b4d48bafee36b4dbfe17c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7926b1f56ccb412fbe53f20b4a9d3749 in term 1.
I20260615 08:05:05.080036 6739 leader_election.cc:304] T 7ddd387b447d4cf48dd7f21a57397363 P 7926b1f56ccb412fbe53f20b4a9d3749 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fc1a983ef6b4d48bafee36b4dbfe17c, 7926b1f56ccb412fbe53f20b4a9d3749; no voters:
I20260615 08:05:05.080116 6974 raft_consensus.cc:2804] T 7ddd387b447d4cf48dd7f21a57397363 P 7926b1f56ccb412fbe53f20b4a9d3749 [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:05:05.080261 6974 raft_consensus.cc:697] T 7ddd387b447d4cf48dd7f21a57397363 P 7926b1f56ccb412fbe53f20b4a9d3749 [term 1 LEADER]: Becoming Leader. State: Replica: 7926b1f56ccb412fbe53f20b4a9d3749, State: Running, Role: LEADER
I20260615 08:05:05.080417 6974 consensus_queue.cc:237] T 7ddd387b447d4cf48dd7f21a57397363 P 7926b1f56ccb412fbe53f20b4a9d3749 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc1a983ef6b4d48bafee36b4dbfe17c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41951 } } peers { permanent_uuid: "bda7c2ee9d29423ea6354799a38b0be1" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 35967 } } peers { permanent_uuid: "7926b1f56ccb412fbe53f20b4a9d3749" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41753 } }
I20260615 08:05:05.080919 6671 catalog_manager.cc:5696] T 7ddd387b447d4cf48dd7f21a57397363 P 7926b1f56ccb412fbe53f20b4a9d3749 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7926b1f56ccb412fbe53f20b4a9d3749 (127.4.42.193). New cstate: current_term: 1 leader_uuid: "7926b1f56ccb412fbe53f20b4a9d3749" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc1a983ef6b4d48bafee36b4dbfe17c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bda7c2ee9d29423ea6354799a38b0be1" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 35967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7926b1f56ccb412fbe53f20b4a9d3749" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41753 } health_report { overall_health: HEALTHY } } }
I20260615 08:05:05.094313 6850 raft_consensus.cc:1275] T 7ddd387b447d4cf48dd7f21a57397363 P bda7c2ee9d29423ea6354799a38b0be1 [term 1 FOLLOWER]: Refusing update from remote peer 7926b1f56ccb412fbe53f20b4a9d3749: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:05:05.094329 6925 raft_consensus.cc:1275] T 7ddd387b447d4cf48dd7f21a57397363 P 1fc1a983ef6b4d48bafee36b4dbfe17c [term 1 FOLLOWER]: Refusing update from remote peer 7926b1f56ccb412fbe53f20b4a9d3749: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:05:05.094573 6974 consensus_queue.cc:1048] T 7ddd387b447d4cf48dd7f21a57397363 P 7926b1f56ccb412fbe53f20b4a9d3749 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bda7c2ee9d29423ea6354799a38b0be1" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 35967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:05:05.094698 6976 consensus_queue.cc:1048] T 7ddd387b447d4cf48dd7f21a57397363 P 7926b1f56ccb412fbe53f20b4a9d3749 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fc1a983ef6b4d48bafee36b4dbfe17c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260615 08:05:15.094722 6983 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36286: Illegal state: Transaction 0 already open
W20260615 08:05:15.095117 6983 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36286: Illegal state: Cannot finalize transaction in state: OPEN
W20260615 08:05:15.096401 6983 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36286: Illegal state: Transaction 0 commit already in progress
W20260615 08:05:15.096700 6983 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36286: Illegal state: Transaction metadata for transaction 0 already exists
W20260615 08:05:15.097854 6983 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36286: Illegal state: Transaction 0 commit already in progress
W20260615 08:05:15.098174 6983 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36286: Illegal state: Transaction metadata for transaction 0 already set
W20260615 08:05:15.098543 6983 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36286: Illegal state: Transaction metadata for transaction 0 already exists
W20260615 08:05:15.098863 6983 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36286: Illegal state: Transaction metadata for transaction 0 already exists
I20260615 08:05:15.099049 4267 tablet_server.cc:179] TabletServer@127.4.42.193:0 shutting down...
I20260615 08:05:15.102240 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:05:15.102357 4267 tablet_replica.cc:333] T 7ddd387b447d4cf48dd7f21a57397363 P 7926b1f56ccb412fbe53f20b4a9d3749: stopping tablet replica
I20260615 08:05:15.102424 4267 raft_consensus.cc:2243] T 7ddd387b447d4cf48dd7f21a57397363 P 7926b1f56ccb412fbe53f20b4a9d3749 [term 1 LEADER]: Raft consensus shutting down.
I20260615 08:05:15.102504 4267 raft_consensus.cc:2272] T 7ddd387b447d4cf48dd7f21a57397363 P 7926b1f56ccb412fbe53f20b4a9d3749 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:05:15.110322 4267 tablet_server.cc:196] TabletServer@127.4.42.193:0 shutdown complete.
I20260615 08:05:15.111140 4267 tablet_server.cc:179] TabletServer@127.4.42.194:0 shutting down...
I20260615 08:05:15.114122 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:05:15.114230 4267 tablet_replica.cc:333] T 7ddd387b447d4cf48dd7f21a57397363 P bda7c2ee9d29423ea6354799a38b0be1: stopping tablet replica
I20260615 08:05:15.114269 4267 raft_consensus.cc:2243] T 7ddd387b447d4cf48dd7f21a57397363 P bda7c2ee9d29423ea6354799a38b0be1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260615 08:05:15.114312 4267 raft_consensus.cc:2272] T 7ddd387b447d4cf48dd7f21a57397363 P bda7c2ee9d29423ea6354799a38b0be1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:05:15.127651 4267 tablet_server.cc:196] TabletServer@127.4.42.194:0 shutdown complete.
I20260615 08:05:15.128448 4267 tablet_server.cc:179] TabletServer@127.4.42.195:0 shutting down...
I20260615 08:05:15.132030 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:05:15.132158 4267 tablet_replica.cc:333] T 7ddd387b447d4cf48dd7f21a57397363 P 1fc1a983ef6b4d48bafee36b4dbfe17c: stopping tablet replica
I20260615 08:05:15.132194 4267 raft_consensus.cc:2243] T 7ddd387b447d4cf48dd7f21a57397363 P 1fc1a983ef6b4d48bafee36b4dbfe17c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260615 08:05:15.132226 4267 raft_consensus.cc:2272] T 7ddd387b447d4cf48dd7f21a57397363 P 1fc1a983ef6b4d48bafee36b4dbfe17c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:05:15.156035 4267 tablet_server.cc:196] TabletServer@127.4.42.195:0 shutdown complete.
I20260615 08:05:15.156922 4267 master.cc:562] Master@127.4.42.254:36683 shutting down...
I20260615 08:05:15.159693 4267 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8a63788d48454a2aa5e5bce44020c560 [term 1 LEADER]: Raft consensus shutting down.
I20260615 08:05:15.159765 4267 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8a63788d48454a2aa5e5bce44020c560 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:05:15.159785 4267 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8a63788d48454a2aa5e5bce44020c560: stopping tablet replica
I20260615 08:05:15.171192 4267 master.cc:584] Master@127.4.42.254:36683 shutdown complete.
[ OK ] TxnParticipantITest.TestProxyIllegalStatesInCommitSequence (10291 ms)
[ RUN ] TxnParticipantITest.TestProxyIllegalStatesInAbortSequence
I20260615 08:05:15.189750 4267 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.42.254:37523
I20260615 08:05:15.189875 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:05:15.191572 7027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:05:15.191646 7030 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:05:15.191722 7028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:05:15.191763 4267 server_base.cc:1061] running on GCE node
I20260615 08:05:15.191890 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:05:15.191927 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:05:15.191977 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510715191976 us; error 0 us; skew 500 ppm
I20260615 08:05:15.192557 4267 webserver.cc:533] Webserver started at http://127.4.42.254:33945/ using document root <none> and password file <none>
I20260615 08:05:15.192654 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:05:15.192701 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:05:15.192747 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:05:15.193053 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1781510637089012-4267-0/minicluster-data/master-0-root/instance:
uuid: "94600073056b4a87883a8863a0ce56d0"
format_stamp: "Formatted at 2026-06-15 08:05:15 on dist-test-slave-37n8"
I20260615 08:05:15.193923 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:05:15.194386 7035 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:15.194556 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:15.194602 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1781510637089012-4267-0/minicluster-data/master-0-root
uuid: "94600073056b4a87883a8863a0ce56d0"
format_stamp: "Formatted at 2026-06-15 08:05:15 on dist-test-slave-37n8"
I20260615 08:05:15.194643 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1781510637089012-4267-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1781510637089012-4267-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1781510637089012-4267-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:05:15.214268 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:05:15.214422 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:05:15.216951 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.254:37523
I20260615 08:05:15.220518 7088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:05:15.220542 7087 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.254:37523 every 8 connection(s)
I20260615 08:05:15.221475 7088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94600073056b4a87883a8863a0ce56d0: Bootstrap starting.
I20260615 08:05:15.221752 7088 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 94600073056b4a87883a8863a0ce56d0: Neither blocks nor log segments found. Creating new log.
I20260615 08:05:15.222198 7088 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94600073056b4a87883a8863a0ce56d0: No bootstrap required, opened a new log
I20260615 08:05:15.222330 7088 raft_consensus.cc:359] T 00000000000000000000000000000000 P 94600073056b4a87883a8863a0ce56d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94600073056b4a87883a8863a0ce56d0" member_type: VOTER }
I20260615 08:05:15.222391 7088 raft_consensus.cc:385] T 00000000000000000000000000000000 P 94600073056b4a87883a8863a0ce56d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:05:15.222422 7088 raft_consensus.cc:740] T 00000000000000000000000000000000 P 94600073056b4a87883a8863a0ce56d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94600073056b4a87883a8863a0ce56d0, State: Initialized, Role: FOLLOWER
I20260615 08:05:15.222476 7088 consensus_queue.cc:260] T 00000000000000000000000000000000 P 94600073056b4a87883a8863a0ce56d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94600073056b4a87883a8863a0ce56d0" member_type: VOTER }
I20260615 08:05:15.222539 7088 raft_consensus.cc:399] T 00000000000000000000000000000000 P 94600073056b4a87883a8863a0ce56d0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260615 08:05:15.222568 7088 raft_consensus.cc:493] T 00000000000000000000000000000000 P 94600073056b4a87883a8863a0ce56d0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260615 08:05:15.222595 7088 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 94600073056b4a87883a8863a0ce56d0 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:05:15.223122 7088 raft_consensus.cc:515] T 00000000000000000000000000000000 P 94600073056b4a87883a8863a0ce56d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94600073056b4a87883a8863a0ce56d0" member_type: VOTER }
I20260615 08:05:15.223201 7088 leader_election.cc:304] T 00000000000000000000000000000000 P 94600073056b4a87883a8863a0ce56d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 94600073056b4a87883a8863a0ce56d0; no voters:
I20260615 08:05:15.223310 7088 leader_election.cc:290] T 00000000000000000000000000000000 P 94600073056b4a87883a8863a0ce56d0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260615 08:05:15.223404 7091 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 94600073056b4a87883a8863a0ce56d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:05:15.223479 7088 sys_catalog.cc:565] T 00000000000000000000000000000000 P 94600073056b4a87883a8863a0ce56d0 [sys.catalog]: configured and running, proceeding with master startup.
I20260615 08:05:15.223532 7091 raft_consensus.cc:697] T 00000000000000000000000000000000 P 94600073056b4a87883a8863a0ce56d0 [term 1 LEADER]: Becoming Leader. State: Replica: 94600073056b4a87883a8863a0ce56d0, State: Running, Role: LEADER
I20260615 08:05:15.223583 7091 consensus_queue.cc:237] T 00000000000000000000000000000000 P 94600073056b4a87883a8863a0ce56d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94600073056b4a87883a8863a0ce56d0" member_type: VOTER }
I20260615 08:05:15.223745 7091 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94600073056b4a87883a8863a0ce56d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 94600073056b4a87883a8863a0ce56d0. Latest consensus state: current_term: 1 leader_uuid: "94600073056b4a87883a8863a0ce56d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94600073056b4a87883a8863a0ce56d0" member_type: VOTER } }
I20260615 08:05:15.223755 7092 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94600073056b4a87883a8863a0ce56d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "94600073056b4a87883a8863a0ce56d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94600073056b4a87883a8863a0ce56d0" member_type: VOTER } }
I20260615 08:05:15.223814 7091 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94600073056b4a87883a8863a0ce56d0 [sys.catalog]: This master's current role is: LEADER
I20260615 08:05:15.223994 7092 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94600073056b4a87883a8863a0ce56d0 [sys.catalog]: This master's current role is: LEADER
I20260615 08:05:15.224674 4267 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
W20260615 08:05:15.224743 7106 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 94600073056b4a87883a8863a0ce56d0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260615 08:05:15.224790 7106 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260615 08:05:15.224864 7099 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260615 08:05:15.224988 7099 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260615 08:05:15.225457 7099 catalog_manager.cc:1382] Generated new cluster ID: 0e4b2fee97ad4fcbbbdd85c4170a9093
I20260615 08:05:15.225502 7099 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260615 08:05:15.245292 7099 catalog_manager.cc:1405] Generated new certificate authority record
I20260615 08:05:15.245743 7099 catalog_manager.cc:1539] Loading token signing keys...
I20260615 08:05:15.249943 7099 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 94600073056b4a87883a8863a0ce56d0: Generated new TSK 0
I20260615 08:05:15.250025 7099 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260615 08:05:15.256531 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:05:15.257928 7112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:05:15.257982 7110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:05:15.258040 4267 server_base.cc:1061] running on GCE node
W20260615 08:05:15.258106 7109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:05:15.258240 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:05:15.258308 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:05:15.258332 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510715258330 us; error 0 us; skew 500 ppm
I20260615 08:05:15.258960 4267 webserver.cc:533] Webserver started at http://127.4.42.193:36149/ using document root <none> and password file <none>
I20260615 08:05:15.259063 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:05:15.259111 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:05:15.259159 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:05:15.259464 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1781510637089012-4267-0/minicluster-data/ts-0-root/instance:
uuid: "ecde02f8fe484b3f8221327db1b99600"
format_stamp: "Formatted at 2026-06-15 08:05:15 on dist-test-slave-37n8"
I20260615 08:05:15.260360 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:05:15.260821 7117 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:15.260967 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:15.261024 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1781510637089012-4267-0/minicluster-data/ts-0-root
uuid: "ecde02f8fe484b3f8221327db1b99600"
format_stamp: "Formatted at 2026-06-15 08:05:15 on dist-test-slave-37n8"
I20260615 08:05:15.261071 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1781510637089012-4267-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1781510637089012-4267-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1781510637089012-4267-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:05:15.283164 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:05:15.283382 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:05:15.283545 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:05:15.283756 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:05:15.283810 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:15.283849 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:05:15.283892 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:15.286777 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.193:44589
I20260615 08:05:15.287410 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260615 08:05:15.287755 7180 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.193:44589 every 8 connection(s)
W20260615 08:05:15.288707 7186 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:05:15.288792 7183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:05:15.288866 7184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:05:15.288851 4267 server_base.cc:1061] running on GCE node
I20260615 08:05:15.289040 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:05:15.289072 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:05:15.289124 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510715289123 us; error 0 us; skew 500 ppm
I20260615 08:05:15.289731 4267 webserver.cc:533] Webserver started at http://127.4.42.194:46015/ using document root <none> and password file <none>
I20260615 08:05:15.289817 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:05:15.289860 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:05:15.289913 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:05:15.290184 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1781510637089012-4267-0/minicluster-data/ts-1-root/instance:
uuid: "466e913d73504dd885e6bb9cf2c01ecf"
format_stamp: "Formatted at 2026-06-15 08:05:15 on dist-test-slave-37n8"
I20260615 08:05:15.291512 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:05:15.292037 7181 heartbeater.cc:344] Connected to a master server at 127.4.42.254:37523
I20260615 08:05:15.292096 7181 heartbeater.cc:461] Registering TS with master...
I20260615 08:05:15.292219 7181 heartbeater.cc:507] Master 127.4.42.254:37523 requested a full tablet report, sending...
I20260615 08:05:15.292459 7193 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:15.292480 7052 ts_manager.cc:194] Registered new tserver with Master: ecde02f8fe484b3f8221327db1b99600 (127.4.42.193:44589)
I20260615 08:05:15.292680 4267 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:05:15.292725 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1781510637089012-4267-0/minicluster-data/ts-1-root
uuid: "466e913d73504dd885e6bb9cf2c01ecf"
format_stamp: "Formatted at 2026-06-15 08:05:15 on dist-test-slave-37n8"
I20260615 08:05:15.292766 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1781510637089012-4267-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1781510637089012-4267-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1781510637089012-4267-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:05:15.293339 7052 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60698
I20260615 08:05:15.302845 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:05:15.303007 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:05:15.303130 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:05:15.303318 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:05:15.303344 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:15.303362 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:05:15.303411 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:15.306097 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.194:42085
I20260615 08:05:15.306154 7256 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.194:42085 every 8 connection(s)
I20260615 08:05:15.306520 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:05:15.307590 7260 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:05:15.307833 4267 server_base.cc:1061] running on GCE node
W20260615 08:05:15.307868 7263 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:05:15.307822 7261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:05:15.308136 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:05:15.308194 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:05:15.308216 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510715308217 us; error 0 us; skew 500 ppm
I20260615 08:05:15.308792 4267 webserver.cc:533] Webserver started at http://127.4.42.195:37881/ using document root <none> and password file <none>
I20260615 08:05:15.308872 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:05:15.308916 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:05:15.308961 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:05:15.309223 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1781510637089012-4267-0/minicluster-data/ts-2-root/instance:
uuid: "ec86506ef7c9481c9e0135da02c696cf"
format_stamp: "Formatted at 2026-06-15 08:05:15 on dist-test-slave-37n8"
I20260615 08:05:15.309713 7257 heartbeater.cc:344] Connected to a master server at 127.4.42.254:37523
I20260615 08:05:15.309768 7257 heartbeater.cc:461] Registering TS with master...
I20260615 08:05:15.309875 7257 heartbeater.cc:507] Master 127.4.42.254:37523 requested a full tablet report, sending...
I20260615 08:05:15.310127 7052 ts_manager.cc:194] Registered new tserver with Master: 466e913d73504dd885e6bb9cf2c01ecf (127.4.42.194:42085)
I20260615 08:05:15.310405 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:05:15.310619 7052 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60712
I20260615 08:05:15.310971 7268 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:15.311103 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:15.311159 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1781510637089012-4267-0/minicluster-data/ts-2-root
uuid: "ec86506ef7c9481c9e0135da02c696cf"
format_stamp: "Formatted at 2026-06-15 08:05:15 on dist-test-slave-37n8"
I20260615 08:05:15.311215 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1781510637089012-4267-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1781510637089012-4267-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyIllegalStatesInAbortSequence.1781510637089012-4267-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:05:15.326117 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:05:15.326321 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:05:15.326539 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:05:15.326740 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:05:15.326766 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:15.326809 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:05:15.326835 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:15.329926 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.195:33547
I20260615 08:05:15.329998 7331 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.195:33547 every 8 connection(s)
I20260615 08:05:15.332947 7332 heartbeater.cc:344] Connected to a master server at 127.4.42.254:37523
I20260615 08:05:15.332999 7332 heartbeater.cc:461] Registering TS with master...
I20260615 08:05:15.333071 7332 heartbeater.cc:507] Master 127.4.42.254:37523 requested a full tablet report, sending...
I20260615 08:05:15.333310 7052 ts_manager.cc:194] Registered new tserver with Master: ec86506ef7c9481c9e0135da02c696cf (127.4.42.195:33547)
I20260615 08:05:15.333468 4267 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.00332226s
I20260615 08:05:15.333738 7052 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60724
I20260615 08:05:15.337987 7052 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60734:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260615 08:05:15.338104 7052 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260615 08:05:15.342794 7145 tablet_service.cc:1511] Processing CreateTablet for tablet f4d39e0b37434cc1901b6a761ce1f95e (DEFAULT_TABLE table=test-workload [id=30884b1917bf454297b04e01f3de35d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:05:15.342923 7145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4d39e0b37434cc1901b6a761ce1f95e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:05:15.343142 7296 tablet_service.cc:1511] Processing CreateTablet for tablet f4d39e0b37434cc1901b6a761ce1f95e (DEFAULT_TABLE table=test-workload [id=30884b1917bf454297b04e01f3de35d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:05:15.343283 7296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4d39e0b37434cc1901b6a761ce1f95e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:05:15.343343 7221 tablet_service.cc:1511] Processing CreateTablet for tablet f4d39e0b37434cc1901b6a761ce1f95e (DEFAULT_TABLE table=test-workload [id=30884b1917bf454297b04e01f3de35d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:05:15.343441 7221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4d39e0b37434cc1901b6a761ce1f95e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:05:15.344683 7349 tablet_bootstrap.cc:492] T f4d39e0b37434cc1901b6a761ce1f95e P 466e913d73504dd885e6bb9cf2c01ecf: Bootstrap starting.
I20260615 08:05:15.344801 7347 tablet_bootstrap.cc:492] T f4d39e0b37434cc1901b6a761ce1f95e P ecde02f8fe484b3f8221327db1b99600: Bootstrap starting.
I20260615 08:05:15.345144 7349 tablet_bootstrap.cc:654] T f4d39e0b37434cc1901b6a761ce1f95e P 466e913d73504dd885e6bb9cf2c01ecf: Neither blocks nor log segments found. Creating new log.
I20260615 08:05:15.345196 7347 tablet_bootstrap.cc:654] T f4d39e0b37434cc1901b6a761ce1f95e P ecde02f8fe484b3f8221327db1b99600: Neither blocks nor log segments found. Creating new log.
I20260615 08:05:15.345542 7348 tablet_bootstrap.cc:492] T f4d39e0b37434cc1901b6a761ce1f95e P ec86506ef7c9481c9e0135da02c696cf: Bootstrap starting.
I20260615 08:05:15.345768 7347 tablet_bootstrap.cc:492] T f4d39e0b37434cc1901b6a761ce1f95e P ecde02f8fe484b3f8221327db1b99600: No bootstrap required, opened a new log
I20260615 08:05:15.345808 7347 ts_tablet_manager.cc:1403] T f4d39e0b37434cc1901b6a761ce1f95e P ecde02f8fe484b3f8221327db1b99600: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:05:15.345958 7348 tablet_bootstrap.cc:654] T f4d39e0b37434cc1901b6a761ce1f95e P ec86506ef7c9481c9e0135da02c696cf: Neither blocks nor log segments found. Creating new log.
I20260615 08:05:15.345956 7347 raft_consensus.cc:359] T f4d39e0b37434cc1901b6a761ce1f95e P ecde02f8fe484b3f8221327db1b99600 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec86506ef7c9481c9e0135da02c696cf" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33547 } } peers { permanent_uuid: "ecde02f8fe484b3f8221327db1b99600" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 44589 } } peers { permanent_uuid: "466e913d73504dd885e6bb9cf2c01ecf" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42085 } }
I20260615 08:05:15.346040 7347 raft_consensus.cc:385] T f4d39e0b37434cc1901b6a761ce1f95e P ecde02f8fe484b3f8221327db1b99600 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:05:15.346062 7347 raft_consensus.cc:740] T f4d39e0b37434cc1901b6a761ce1f95e P ecde02f8fe484b3f8221327db1b99600 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecde02f8fe484b3f8221327db1b99600, State: Initialized, Role: FOLLOWER
I20260615 08:05:15.346095 7349 tablet_bootstrap.cc:492] T f4d39e0b37434cc1901b6a761ce1f95e P 466e913d73504dd885e6bb9cf2c01ecf: No bootstrap required, opened a new log
I20260615 08:05:15.346132 7349 ts_tablet_manager.cc:1403] T f4d39e0b37434cc1901b6a761ce1f95e P 466e913d73504dd885e6bb9cf2c01ecf: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:05:15.346144 7347 consensus_queue.cc:260] T f4d39e0b37434cc1901b6a761ce1f95e P ecde02f8fe484b3f8221327db1b99600 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec86506ef7c9481c9e0135da02c696cf" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33547 } } peers { permanent_uuid: "ecde02f8fe484b3f8221327db1b99600" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 44589 } } peers { permanent_uuid: "466e913d73504dd885e6bb9cf2c01ecf" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42085 } }
I20260615 08:05:15.346269 7349 raft_consensus.cc:359] T f4d39e0b37434cc1901b6a761ce1f95e P 466e913d73504dd885e6bb9cf2c01ecf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec86506ef7c9481c9e0135da02c696cf" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33547 } } peers { permanent_uuid: "ecde02f8fe484b3f8221327db1b99600" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 44589 } } peers { permanent_uuid: "466e913d73504dd885e6bb9cf2c01ecf" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42085 } }
I20260615 08:05:15.346311 7347 ts_tablet_manager.cc:1434] T f4d39e0b37434cc1901b6a761ce1f95e P ecde02f8fe484b3f8221327db1b99600: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260615 08:05:15.346351 7349 raft_consensus.cc:385] T f4d39e0b37434cc1901b6a761ce1f95e P 466e913d73504dd885e6bb9cf2c01ecf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:05:15.346335 7181 heartbeater.cc:499] Master 127.4.42.254:37523 was elected leader, sending a full tablet report...
I20260615 08:05:15.346375 7349 raft_consensus.cc:740] T f4d39e0b37434cc1901b6a761ce1f95e P 466e913d73504dd885e6bb9cf2c01ecf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 466e913d73504dd885e6bb9cf2c01ecf, State: Initialized, Role: FOLLOWER
I20260615 08:05:15.346554 7349 consensus_queue.cc:260] T f4d39e0b37434cc1901b6a761ce1f95e P 466e913d73504dd885e6bb9cf2c01ecf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec86506ef7c9481c9e0135da02c696cf" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33547 } } peers { permanent_uuid: "ecde02f8fe484b3f8221327db1b99600" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 44589 } } peers { permanent_uuid: "466e913d73504dd885e6bb9cf2c01ecf" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42085 } }
I20260615 08:05:15.346751 7349 ts_tablet_manager.cc:1434] T f4d39e0b37434cc1901b6a761ce1f95e P 466e913d73504dd885e6bb9cf2c01ecf: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:05:15.346773 7257 heartbeater.cc:499] Master 127.4.42.254:37523 was elected leader, sending a full tablet report...
I20260615 08:05:15.346881 7348 tablet_bootstrap.cc:492] T f4d39e0b37434cc1901b6a761ce1f95e P ec86506ef7c9481c9e0135da02c696cf: No bootstrap required, opened a new log
I20260615 08:05:15.346925 7348 ts_tablet_manager.cc:1403] T f4d39e0b37434cc1901b6a761ce1f95e P ec86506ef7c9481c9e0135da02c696cf: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:05:15.347076 7348 raft_consensus.cc:359] T f4d39e0b37434cc1901b6a761ce1f95e P ec86506ef7c9481c9e0135da02c696cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec86506ef7c9481c9e0135da02c696cf" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33547 } } peers { permanent_uuid: "ecde02f8fe484b3f8221327db1b99600" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 44589 } } peers { permanent_uuid: "466e913d73504dd885e6bb9cf2c01ecf" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42085 } }
I20260615 08:05:15.347146 7348 raft_consensus.cc:385] T f4d39e0b37434cc1901b6a761ce1f95e P ec86506ef7c9481c9e0135da02c696cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:05:15.347170 7348 raft_consensus.cc:740] T f4d39e0b37434cc1901b6a761ce1f95e P ec86506ef7c9481c9e0135da02c696cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec86506ef7c9481c9e0135da02c696cf, State: Initialized, Role: FOLLOWER
I20260615 08:05:15.347219 7348 consensus_queue.cc:260] T f4d39e0b37434cc1901b6a761ce1f95e P ec86506ef7c9481c9e0135da02c696cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec86506ef7c9481c9e0135da02c696cf" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33547 } } peers { permanent_uuid: "ecde02f8fe484b3f8221327db1b99600" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 44589 } } peers { permanent_uuid: "466e913d73504dd885e6bb9cf2c01ecf" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42085 } }
I20260615 08:05:15.347383 7348 ts_tablet_manager.cc:1434] T f4d39e0b37434cc1901b6a761ce1f95e P ec86506ef7c9481c9e0135da02c696cf: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:15.347399 7332 heartbeater.cc:499] Master 127.4.42.254:37523 was elected leader, sending a full tablet report...
I20260615 08:05:15.386395 7352 raft_consensus.cc:493] T f4d39e0b37434cc1901b6a761ce1f95e P ecde02f8fe484b3f8221327db1b99600 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260615 08:05:15.386471 7352 raft_consensus.cc:515] T f4d39e0b37434cc1901b6a761ce1f95e P ecde02f8fe484b3f8221327db1b99600 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec86506ef7c9481c9e0135da02c696cf" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33547 } } peers { permanent_uuid: "ecde02f8fe484b3f8221327db1b99600" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 44589 } } peers { permanent_uuid: "466e913d73504dd885e6bb9cf2c01ecf" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42085 } }
I20260615 08:05:15.386690 7352 leader_election.cc:290] T f4d39e0b37434cc1901b6a761ce1f95e P ecde02f8fe484b3f8221327db1b99600 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec86506ef7c9481c9e0135da02c696cf (127.4.42.195:33547), 466e913d73504dd885e6bb9cf2c01ecf (127.4.42.194:42085)
I20260615 08:05:15.389274 7306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d39e0b37434cc1901b6a761ce1f95e" candidate_uuid: "ecde02f8fe484b3f8221327db1b99600" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec86506ef7c9481c9e0135da02c696cf" is_pre_election: true
I20260615 08:05:15.389302 7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d39e0b37434cc1901b6a761ce1f95e" candidate_uuid: "ecde02f8fe484b3f8221327db1b99600" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "466e913d73504dd885e6bb9cf2c01ecf" is_pre_election: true
I20260615 08:05:15.389360 7306 raft_consensus.cc:2468] T f4d39e0b37434cc1901b6a761ce1f95e P ec86506ef7c9481c9e0135da02c696cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecde02f8fe484b3f8221327db1b99600 in term 0.
I20260615 08:05:15.389367 7231 raft_consensus.cc:2468] T f4d39e0b37434cc1901b6a761ce1f95e P 466e913d73504dd885e6bb9cf2c01ecf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ecde02f8fe484b3f8221327db1b99600 in term 0.
I20260615 08:05:15.389539 7121 leader_election.cc:304] T f4d39e0b37434cc1901b6a761ce1f95e P ecde02f8fe484b3f8221327db1b99600 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ec86506ef7c9481c9e0135da02c696cf, ecde02f8fe484b3f8221327db1b99600; no voters:
I20260615 08:05:15.389626 7352 raft_consensus.cc:2804] T f4d39e0b37434cc1901b6a761ce1f95e P ecde02f8fe484b3f8221327db1b99600 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260615 08:05:15.389659 7352 raft_consensus.cc:493] T f4d39e0b37434cc1901b6a761ce1f95e P ecde02f8fe484b3f8221327db1b99600 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:05:15.389673 7352 raft_consensus.cc:3060] T f4d39e0b37434cc1901b6a761ce1f95e P ecde02f8fe484b3f8221327db1b99600 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:05:15.390237 7352 raft_consensus.cc:515] T f4d39e0b37434cc1901b6a761ce1f95e P ecde02f8fe484b3f8221327db1b99600 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec86506ef7c9481c9e0135da02c696cf" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33547 } } peers { permanent_uuid: "ecde02f8fe484b3f8221327db1b99600" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 44589 } } peers { permanent_uuid: "466e913d73504dd885e6bb9cf2c01ecf" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42085 } }
I20260615 08:05:15.390331 7352 leader_election.cc:290] T f4d39e0b37434cc1901b6a761ce1f95e P ecde02f8fe484b3f8221327db1b99600 [CANDIDATE]: Term 1 election: Requested vote from peers ec86506ef7c9481c9e0135da02c696cf (127.4.42.195:33547), 466e913d73504dd885e6bb9cf2c01ecf (127.4.42.194:42085)
I20260615 08:05:15.390506 7231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d39e0b37434cc1901b6a761ce1f95e" candidate_uuid: "ecde02f8fe484b3f8221327db1b99600" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "466e913d73504dd885e6bb9cf2c01ecf"
I20260615 08:05:15.390579 7231 raft_consensus.cc:3060] T f4d39e0b37434cc1901b6a761ce1f95e P 466e913d73504dd885e6bb9cf2c01ecf [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:05:15.390506 7306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d39e0b37434cc1901b6a761ce1f95e" candidate_uuid: "ecde02f8fe484b3f8221327db1b99600" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec86506ef7c9481c9e0135da02c696cf"
I20260615 08:05:15.390618 7306 raft_consensus.cc:3060] T f4d39e0b37434cc1901b6a761ce1f95e P ec86506ef7c9481c9e0135da02c696cf [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:05:15.391145 7231 raft_consensus.cc:2468] T f4d39e0b37434cc1901b6a761ce1f95e P 466e913d73504dd885e6bb9cf2c01ecf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecde02f8fe484b3f8221327db1b99600 in term 1.
I20260615 08:05:15.391311 7119 leader_election.cc:304] T f4d39e0b37434cc1901b6a761ce1f95e P ecde02f8fe484b3f8221327db1b99600 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 466e913d73504dd885e6bb9cf2c01ecf, ecde02f8fe484b3f8221327db1b99600; no voters:
I20260615 08:05:15.391342 7306 raft_consensus.cc:2468] T f4d39e0b37434cc1901b6a761ce1f95e P ec86506ef7c9481c9e0135da02c696cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ecde02f8fe484b3f8221327db1b99600 in term 1.
I20260615 08:05:15.391448 7352 raft_consensus.cc:2804] T f4d39e0b37434cc1901b6a761ce1f95e P ecde02f8fe484b3f8221327db1b99600 [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:05:15.391600 7352 raft_consensus.cc:697] T f4d39e0b37434cc1901b6a761ce1f95e P ecde02f8fe484b3f8221327db1b99600 [term 1 LEADER]: Becoming Leader. State: Replica: ecde02f8fe484b3f8221327db1b99600, State: Running, Role: LEADER
I20260615 08:05:15.391664 7352 consensus_queue.cc:237] T f4d39e0b37434cc1901b6a761ce1f95e P ecde02f8fe484b3f8221327db1b99600 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec86506ef7c9481c9e0135da02c696cf" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33547 } } peers { permanent_uuid: "ecde02f8fe484b3f8221327db1b99600" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 44589 } } peers { permanent_uuid: "466e913d73504dd885e6bb9cf2c01ecf" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42085 } }
I20260615 08:05:15.392150 7052 catalog_manager.cc:5696] T f4d39e0b37434cc1901b6a761ce1f95e P ecde02f8fe484b3f8221327db1b99600 reported cstate change: term changed from 0 to 1, leader changed from <none> to ecde02f8fe484b3f8221327db1b99600 (127.4.42.193). New cstate: current_term: 1 leader_uuid: "ecde02f8fe484b3f8221327db1b99600" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec86506ef7c9481c9e0135da02c696cf" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecde02f8fe484b3f8221327db1b99600" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 44589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "466e913d73504dd885e6bb9cf2c01ecf" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42085 } health_report { overall_health: UNKNOWN } } }
I20260615 08:05:15.408406 7231 raft_consensus.cc:1275] T f4d39e0b37434cc1901b6a761ce1f95e P 466e913d73504dd885e6bb9cf2c01ecf [term 1 FOLLOWER]: Refusing update from remote peer ecde02f8fe484b3f8221327db1b99600: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:05:15.408528 7306 raft_consensus.cc:1275] T f4d39e0b37434cc1901b6a761ce1f95e P ec86506ef7c9481c9e0135da02c696cf [term 1 FOLLOWER]: Refusing update from remote peer ecde02f8fe484b3f8221327db1b99600: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:05:15.408716 7357 consensus_queue.cc:1048] T f4d39e0b37434cc1901b6a761ce1f95e P ecde02f8fe484b3f8221327db1b99600 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec86506ef7c9481c9e0135da02c696cf" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:05:15.408831 7352 consensus_queue.cc:1048] T f4d39e0b37434cc1901b6a761ce1f95e P ecde02f8fe484b3f8221327db1b99600 [LEADER]: Connected to new peer: Peer: permanent_uuid: "466e913d73504dd885e6bb9cf2c01ecf" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:05:15.411818 7367 mvcc.cc:204] Tried to move back new op lower bound from 7297067890313363456 to 7297067890244771840. Current Snapshot: MvccSnapshot[applied={T|T < 7297067890311684096}]
W20260615 08:05:25.409360 7364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41752: Illegal state: Transaction 0 already open
W20260615 08:05:25.409734 7364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41752: Illegal state: Cannot finalize transaction in state: OPEN
W20260615 08:05:25.410950 7364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41752: Illegal state: Transaction metadata for transaction 0 already set
W20260615 08:05:25.411294 7364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41752: Illegal state: Transaction metadata for transaction 0 already exists
W20260615 08:05:25.411590 7364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41752: Illegal state: Transaction metadata for transaction 0 already exists
W20260615 08:05:25.411903 7364 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41752: Illegal state: Cannot begin committing transaction in state: INITIALIZING
I20260615 08:05:25.412084 4267 tablet_server.cc:179] TabletServer@127.4.42.193:0 shutting down...
I20260615 08:05:25.414695 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:05:25.414795 4267 tablet_replica.cc:333] T f4d39e0b37434cc1901b6a761ce1f95e P ecde02f8fe484b3f8221327db1b99600: stopping tablet replica
I20260615 08:05:25.414847 4267 raft_consensus.cc:2243] T f4d39e0b37434cc1901b6a761ce1f95e P ecde02f8fe484b3f8221327db1b99600 [term 1 LEADER]: Raft consensus shutting down.
I20260615 08:05:25.414902 4267 raft_consensus.cc:2272] T f4d39e0b37434cc1901b6a761ce1f95e P ecde02f8fe484b3f8221327db1b99600 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:05:25.418673 4267 tablet_server.cc:196] TabletServer@127.4.42.193:0 shutdown complete.
I20260615 08:05:25.419430 4267 tablet_server.cc:179] TabletServer@127.4.42.194:0 shutting down...
I20260615 08:05:25.421783 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:05:25.421888 4267 tablet_replica.cc:333] T f4d39e0b37434cc1901b6a761ce1f95e P 466e913d73504dd885e6bb9cf2c01ecf: stopping tablet replica
I20260615 08:05:25.421936 4267 raft_consensus.cc:2243] T f4d39e0b37434cc1901b6a761ce1f95e P 466e913d73504dd885e6bb9cf2c01ecf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260615 08:05:25.421978 4267 raft_consensus.cc:2272] T f4d39e0b37434cc1901b6a761ce1f95e P 466e913d73504dd885e6bb9cf2c01ecf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:05:25.441251 4267 tablet_server.cc:196] TabletServer@127.4.42.194:0 shutdown complete.
I20260615 08:05:25.441996 4267 tablet_server.cc:179] TabletServer@127.4.42.195:0 shutting down...
I20260615 08:05:25.445040 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:05:25.445132 4267 tablet_replica.cc:333] T f4d39e0b37434cc1901b6a761ce1f95e P ec86506ef7c9481c9e0135da02c696cf: stopping tablet replica
I20260615 08:05:25.445194 4267 raft_consensus.cc:2243] T f4d39e0b37434cc1901b6a761ce1f95e P ec86506ef7c9481c9e0135da02c696cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260615 08:05:25.445236 4267 raft_consensus.cc:2272] T f4d39e0b37434cc1901b6a761ce1f95e P ec86506ef7c9481c9e0135da02c696cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:05:25.458806 4267 tablet_server.cc:196] TabletServer@127.4.42.195:0 shutdown complete.
I20260615 08:05:25.459619 4267 master.cc:562] Master@127.4.42.254:37523 shutting down...
I20260615 08:05:25.461846 4267 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 94600073056b4a87883a8863a0ce56d0 [term 1 LEADER]: Raft consensus shutting down.
I20260615 08:05:25.461927 4267 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 94600073056b4a87883a8863a0ce56d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:05:25.461966 4267 tablet_replica.cc:333] T 00000000000000000000000000000000 P 94600073056b4a87883a8863a0ce56d0: stopping tablet replica
I20260615 08:05:25.473636 4267 master.cc:584] Master@127.4.42.254:37523 shutdown complete.
[ OK ] TxnParticipantITest.TestProxyIllegalStatesInAbortSequence (10302 ms)
[ RUN ] TxnParticipantITest.TestProxyNonLeader
I20260615 08:05:25.492128 4267 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.42.254:36481
I20260615 08:05:25.492311 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:05:25.493660 7411 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:05:25.493685 7408 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:05:25.493736 7409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:05:25.493778 4267 server_base.cc:1061] running on GCE node
I20260615 08:05:25.493956 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:05:25.494014 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:05:25.494028 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510725494028 us; error 0 us; skew 500 ppm
I20260615 08:05:25.494585 4267 webserver.cc:533] Webserver started at http://127.4.42.254:33339/ using document root <none> and password file <none>
I20260615 08:05:25.494659 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:05:25.494691 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:05:25.494724 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:05:25.494949 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1781510637089012-4267-0/minicluster-data/master-0-root/instance:
uuid: "c1fb8ad8ec6f402ab9859f2042e6fbde"
format_stamp: "Formatted at 2026-06-15 08:05:25 on dist-test-slave-37n8"
I20260615 08:05:25.495769 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:05:25.496165 7416 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:25.496301 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:25.496359 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1781510637089012-4267-0/minicluster-data/master-0-root
uuid: "c1fb8ad8ec6f402ab9859f2042e6fbde"
format_stamp: "Formatted at 2026-06-15 08:05:25 on dist-test-slave-37n8"
I20260615 08:05:25.496402 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1781510637089012-4267-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1781510637089012-4267-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1781510637089012-4267-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:05:25.516561 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:05:25.516757 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:05:25.519326 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.254:36481
I20260615 08:05:25.520005 7468 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.254:36481 every 8 connection(s)
I20260615 08:05:25.520138 7469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:05:25.532056 7469 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1fb8ad8ec6f402ab9859f2042e6fbde: Bootstrap starting.
I20260615 08:05:25.532408 7469 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c1fb8ad8ec6f402ab9859f2042e6fbde: Neither blocks nor log segments found. Creating new log.
I20260615 08:05:25.532893 7469 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1fb8ad8ec6f402ab9859f2042e6fbde: No bootstrap required, opened a new log
I20260615 08:05:25.533030 7469 raft_consensus.cc:359] T 00000000000000000000000000000000 P c1fb8ad8ec6f402ab9859f2042e6fbde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1fb8ad8ec6f402ab9859f2042e6fbde" member_type: VOTER }
I20260615 08:05:25.533090 7469 raft_consensus.cc:385] T 00000000000000000000000000000000 P c1fb8ad8ec6f402ab9859f2042e6fbde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:05:25.533114 7469 raft_consensus.cc:740] T 00000000000000000000000000000000 P c1fb8ad8ec6f402ab9859f2042e6fbde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1fb8ad8ec6f402ab9859f2042e6fbde, State: Initialized, Role: FOLLOWER
I20260615 08:05:25.533165 7469 consensus_queue.cc:260] T 00000000000000000000000000000000 P c1fb8ad8ec6f402ab9859f2042e6fbde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1fb8ad8ec6f402ab9859f2042e6fbde" member_type: VOTER }
I20260615 08:05:25.533209 7469 raft_consensus.cc:399] T 00000000000000000000000000000000 P c1fb8ad8ec6f402ab9859f2042e6fbde [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260615 08:05:25.533236 7469 raft_consensus.cc:493] T 00000000000000000000000000000000 P c1fb8ad8ec6f402ab9859f2042e6fbde [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260615 08:05:25.533267 7469 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c1fb8ad8ec6f402ab9859f2042e6fbde [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:05:25.533787 7469 raft_consensus.cc:515] T 00000000000000000000000000000000 P c1fb8ad8ec6f402ab9859f2042e6fbde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1fb8ad8ec6f402ab9859f2042e6fbde" member_type: VOTER }
I20260615 08:05:25.533860 7469 leader_election.cc:304] T 00000000000000000000000000000000 P c1fb8ad8ec6f402ab9859f2042e6fbde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c1fb8ad8ec6f402ab9859f2042e6fbde; no voters:
I20260615 08:05:25.533978 7469 leader_election.cc:290] T 00000000000000000000000000000000 P c1fb8ad8ec6f402ab9859f2042e6fbde [CANDIDATE]: Term 1 election: Requested vote from peers
I20260615 08:05:25.534030 7472 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c1fb8ad8ec6f402ab9859f2042e6fbde [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:05:25.534124 7469 sys_catalog.cc:565] T 00000000000000000000000000000000 P c1fb8ad8ec6f402ab9859f2042e6fbde [sys.catalog]: configured and running, proceeding with master startup.
I20260615 08:05:25.534197 7472 raft_consensus.cc:697] T 00000000000000000000000000000000 P c1fb8ad8ec6f402ab9859f2042e6fbde [term 1 LEADER]: Becoming Leader. State: Replica: c1fb8ad8ec6f402ab9859f2042e6fbde, State: Running, Role: LEADER
I20260615 08:05:25.534276 7472 consensus_queue.cc:237] T 00000000000000000000000000000000 P c1fb8ad8ec6f402ab9859f2042e6fbde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1fb8ad8ec6f402ab9859f2042e6fbde" member_type: VOTER }
I20260615 08:05:25.534579 7473 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1fb8ad8ec6f402ab9859f2042e6fbde [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c1fb8ad8ec6f402ab9859f2042e6fbde" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1fb8ad8ec6f402ab9859f2042e6fbde" member_type: VOTER } }
I20260615 08:05:25.534596 7474 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1fb8ad8ec6f402ab9859f2042e6fbde [sys.catalog]: SysCatalogTable state changed. Reason: New leader c1fb8ad8ec6f402ab9859f2042e6fbde. Latest consensus state: current_term: 1 leader_uuid: "c1fb8ad8ec6f402ab9859f2042e6fbde" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1fb8ad8ec6f402ab9859f2042e6fbde" member_type: VOTER } }
I20260615 08:05:25.534662 7473 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1fb8ad8ec6f402ab9859f2042e6fbde [sys.catalog]: This master's current role is: LEADER
I20260615 08:05:25.534682 7474 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1fb8ad8ec6f402ab9859f2042e6fbde [sys.catalog]: This master's current role is: LEADER
I20260615 08:05:25.534879 7478 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260615 08:05:25.535022 7478 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260615 08:05:25.535542 4267 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260615 08:05:25.535554 7478 catalog_manager.cc:1382] Generated new cluster ID: e10bb8e0868a4c6f80edcc2f4ffd25d0
I20260615 08:05:25.535619 7478 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260615 08:05:25.542079 7478 catalog_manager.cc:1405] Generated new certificate authority record
I20260615 08:05:25.542510 7478 catalog_manager.cc:1539] Loading token signing keys...
I20260615 08:05:25.548579 7478 catalog_manager.cc:6069] T 00000000000000000000000000000000 P c1fb8ad8ec6f402ab9859f2042e6fbde: Generated new TSK 0
I20260615 08:05:25.548662 7478 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260615 08:05:25.551115 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:05:25.552306 7490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:05:25.552388 7491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:05:25.552434 4267 server_base.cc:1061] running on GCE node
W20260615 08:05:25.552433 7493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:05:25.552641 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:05:25.552682 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:05:25.552695 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510725552695 us; error 0 us; skew 500 ppm
I20260615 08:05:25.553289 4267 webserver.cc:533] Webserver started at http://127.4.42.193:44775/ using document root <none> and password file <none>
I20260615 08:05:25.553377 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:05:25.553419 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:05:25.553465 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:05:25.553731 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1781510637089012-4267-0/minicluster-data/ts-0-root/instance:
uuid: "21c73d92902045d5b182df2e62bf6f9b"
format_stamp: "Formatted at 2026-06-15 08:05:25 on dist-test-slave-37n8"
I20260615 08:05:25.554776 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:05:25.555389 7498 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:25.555567 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:25.555619 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1781510637089012-4267-0/minicluster-data/ts-0-root
uuid: "21c73d92902045d5b182df2e62bf6f9b"
format_stamp: "Formatted at 2026-06-15 08:05:25 on dist-test-slave-37n8"
I20260615 08:05:25.555666 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1781510637089012-4267-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1781510637089012-4267-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1781510637089012-4267-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:05:25.573611 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:05:25.573789 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:05:25.573938 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:05:25.574127 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:05:25.574173 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:25.574209 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:05:25.574246 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:25.576915 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.193:33811
I20260615 08:05:25.576946 7561 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.193:33811 every 8 connection(s)
I20260615 08:05:25.577306 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:05:25.578318 7566 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:05:25.578346 7569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:05:25.578981 7567 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:05:25.579104 4267 server_base.cc:1061] running on GCE node
I20260615 08:05:25.579224 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:05:25.579252 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:05:25.579267 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510725579268 us; error 0 us; skew 500 ppm
I20260615 08:05:25.579804 4267 webserver.cc:533] Webserver started at http://127.4.42.194:36077/ using document root <none> and password file <none>
I20260615 08:05:25.579936 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:05:25.580039 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:05:25.580091 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:05:25.580463 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1781510637089012-4267-0/minicluster-data/ts-1-root/instance:
uuid: "5bee3b6d130341efb29315ffbd928b7b"
format_stamp: "Formatted at 2026-06-15 08:05:25 on dist-test-slave-37n8"
I20260615 08:05:25.581008 7562 heartbeater.cc:344] Connected to a master server at 127.4.42.254:36481
I20260615 08:05:25.581058 7562 heartbeater.cc:461] Registering TS with master...
I20260615 08:05:25.581166 7562 heartbeater.cc:507] Master 127.4.42.254:36481 requested a full tablet report, sending...
I20260615 08:05:25.581400 7433 ts_manager.cc:194] Registered new tserver with Master: 21c73d92902045d5b182df2e62bf6f9b (127.4.42.193:33811)
I20260615 08:05:25.581574 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:05:25.582000 7433 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54708
I20260615 08:05:25.582069 7574 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:25.582183 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:25.582233 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1781510637089012-4267-0/minicluster-data/ts-1-root
uuid: "5bee3b6d130341efb29315ffbd928b7b"
format_stamp: "Formatted at 2026-06-15 08:05:25 on dist-test-slave-37n8"
I20260615 08:05:25.582275 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1781510637089012-4267-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1781510637089012-4267-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1781510637089012-4267-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:05:25.589962 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:05:25.590126 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:05:25.590270 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:05:25.590451 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:05:25.590474 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:25.590533 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:05:25.590556 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:25.593540 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.194:37429
I20260615 08:05:25.593604 7637 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.194:37429 every 8 connection(s)
I20260615 08:05:25.593967 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:05:25.594942 7641 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:05:25.594970 7642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:05:25.595187 4267 server_base.cc:1061] running on GCE node
W20260615 08:05:25.595199 7644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:05:25.595400 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:05:25.595445 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:05:25.595463 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510725595463 us; error 0 us; skew 500 ppm
I20260615 08:05:25.595958 4267 webserver.cc:533] Webserver started at http://127.4.42.195:42411/ using document root <none> and password file <none>
I20260615 08:05:25.596043 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:05:25.596086 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:05:25.596131 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:05:25.596369 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1781510637089012-4267-0/minicluster-data/ts-2-root/instance:
uuid: "33a7dd35d8a14b78a5c1da94de967166"
format_stamp: "Formatted at 2026-06-15 08:05:25 on dist-test-slave-37n8"
I20260615 08:05:25.597272 7638 heartbeater.cc:344] Connected to a master server at 127.4.42.254:36481
I20260615 08:05:25.597357 7638 heartbeater.cc:461] Registering TS with master...
I20260615 08:05:25.597473 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:05:25.597476 7638 heartbeater.cc:507] Master 127.4.42.254:36481 requested a full tablet report, sending...
I20260615 08:05:25.597759 7433 ts_manager.cc:194] Registered new tserver with Master: 5bee3b6d130341efb29315ffbd928b7b (127.4.42.194:37429)
I20260615 08:05:25.598034 7649 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:25.598145 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:25.598192 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1781510637089012-4267-0/minicluster-data/ts-2-root
uuid: "33a7dd35d8a14b78a5c1da94de967166"
format_stamp: "Formatted at 2026-06-15 08:05:25 on dist-test-slave-37n8"
I20260615 08:05:25.598237 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1781510637089012-4267-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1781510637089012-4267-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyNonLeader.1781510637089012-4267-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:05:25.598254 7433 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54724
I20260615 08:05:25.607297 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:05:25.607489 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:05:25.607640 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:05:25.607843 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:05:25.607869 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:25.607911 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:05:25.607940 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:25.611074 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.195:42671
I20260615 08:05:25.611131 7712 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.195:42671 every 8 connection(s)
I20260615 08:05:25.613821 7713 heartbeater.cc:344] Connected to a master server at 127.4.42.254:36481
I20260615 08:05:25.613867 7713 heartbeater.cc:461] Registering TS with master...
I20260615 08:05:25.613936 7713 heartbeater.cc:507] Master 127.4.42.254:36481 requested a full tablet report, sending...
I20260615 08:05:25.614151 7433 ts_manager.cc:194] Registered new tserver with Master: 33a7dd35d8a14b78a5c1da94de967166 (127.4.42.195:42671)
I20260615 08:05:25.614462 7433 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54738
I20260615 08:05:25.614634 4267 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003355952s
I20260615 08:05:25.619120 7433 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54744:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260615 08:05:25.619287 7433 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260615 08:05:25.623843 7602 tablet_service.cc:1511] Processing CreateTablet for tablet ac7682543d094ecbbf811d337601352b (DEFAULT_TABLE table=test-workload [id=49a2aaaf05964e2d9796878d8b8e921e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:05:25.623958 7602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac7682543d094ecbbf811d337601352b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:05:25.624414 7677 tablet_service.cc:1511] Processing CreateTablet for tablet ac7682543d094ecbbf811d337601352b (DEFAULT_TABLE table=test-workload [id=49a2aaaf05964e2d9796878d8b8e921e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:05:25.624512 7677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac7682543d094ecbbf811d337601352b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:05:25.625265 7728 tablet_bootstrap.cc:492] T ac7682543d094ecbbf811d337601352b P 5bee3b6d130341efb29315ffbd928b7b: Bootstrap starting.
I20260615 08:05:25.625661 7728 tablet_bootstrap.cc:654] T ac7682543d094ecbbf811d337601352b P 5bee3b6d130341efb29315ffbd928b7b: Neither blocks nor log segments found. Creating new log.
I20260615 08:05:25.626149 7729 tablet_bootstrap.cc:492] T ac7682543d094ecbbf811d337601352b P 33a7dd35d8a14b78a5c1da94de967166: Bootstrap starting.
I20260615 08:05:25.626212 7526 tablet_service.cc:1511] Processing CreateTablet for tablet ac7682543d094ecbbf811d337601352b (DEFAULT_TABLE table=test-workload [id=49a2aaaf05964e2d9796878d8b8e921e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:05:25.626278 7728 tablet_bootstrap.cc:492] T ac7682543d094ecbbf811d337601352b P 5bee3b6d130341efb29315ffbd928b7b: No bootstrap required, opened a new log
I20260615 08:05:25.626313 7526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac7682543d094ecbbf811d337601352b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:05:25.626327 7728 ts_tablet_manager.cc:1403] T ac7682543d094ecbbf811d337601352b P 5bee3b6d130341efb29315ffbd928b7b: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:05:25.626586 7729 tablet_bootstrap.cc:654] T ac7682543d094ecbbf811d337601352b P 33a7dd35d8a14b78a5c1da94de967166: Neither blocks nor log segments found. Creating new log.
I20260615 08:05:25.626546 7728 raft_consensus.cc:359] T ac7682543d094ecbbf811d337601352b P 5bee3b6d130341efb29315ffbd928b7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c73d92902045d5b182df2e62bf6f9b" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33811 } } peers { permanent_uuid: "5bee3b6d130341efb29315ffbd928b7b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 37429 } } peers { permanent_uuid: "33a7dd35d8a14b78a5c1da94de967166" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42671 } }
I20260615 08:05:25.626784 7728 raft_consensus.cc:385] T ac7682543d094ecbbf811d337601352b P 5bee3b6d130341efb29315ffbd928b7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:05:25.626817 7728 raft_consensus.cc:740] T ac7682543d094ecbbf811d337601352b P 5bee3b6d130341efb29315ffbd928b7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bee3b6d130341efb29315ffbd928b7b, State: Initialized, Role: FOLLOWER
I20260615 08:05:25.626869 7728 consensus_queue.cc:260] T ac7682543d094ecbbf811d337601352b P 5bee3b6d130341efb29315ffbd928b7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c73d92902045d5b182df2e62bf6f9b" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33811 } } peers { permanent_uuid: "5bee3b6d130341efb29315ffbd928b7b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 37429 } } peers { permanent_uuid: "33a7dd35d8a14b78a5c1da94de967166" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42671 } }
I20260615 08:05:25.627032 7728 ts_tablet_manager.cc:1434] T ac7682543d094ecbbf811d337601352b P 5bee3b6d130341efb29315ffbd928b7b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260615 08:05:25.627050 7638 heartbeater.cc:499] Master 127.4.42.254:36481 was elected leader, sending a full tablet report...
I20260615 08:05:25.627180 7729 tablet_bootstrap.cc:492] T ac7682543d094ecbbf811d337601352b P 33a7dd35d8a14b78a5c1da94de967166: No bootstrap required, opened a new log
I20260615 08:05:25.627233 7729 ts_tablet_manager.cc:1403] T ac7682543d094ecbbf811d337601352b P 33a7dd35d8a14b78a5c1da94de967166: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:05:25.627367 7729 raft_consensus.cc:359] T ac7682543d094ecbbf811d337601352b P 33a7dd35d8a14b78a5c1da94de967166 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c73d92902045d5b182df2e62bf6f9b" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33811 } } peers { permanent_uuid: "5bee3b6d130341efb29315ffbd928b7b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 37429 } } peers { permanent_uuid: "33a7dd35d8a14b78a5c1da94de967166" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42671 } }
I20260615 08:05:25.627427 7729 raft_consensus.cc:385] T ac7682543d094ecbbf811d337601352b P 33a7dd35d8a14b78a5c1da94de967166 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:05:25.627453 7729 raft_consensus.cc:740] T ac7682543d094ecbbf811d337601352b P 33a7dd35d8a14b78a5c1da94de967166 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33a7dd35d8a14b78a5c1da94de967166, State: Initialized, Role: FOLLOWER
I20260615 08:05:25.627496 7729 consensus_queue.cc:260] T ac7682543d094ecbbf811d337601352b P 33a7dd35d8a14b78a5c1da94de967166 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c73d92902045d5b182df2e62bf6f9b" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33811 } } peers { permanent_uuid: "5bee3b6d130341efb29315ffbd928b7b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 37429 } } peers { permanent_uuid: "33a7dd35d8a14b78a5c1da94de967166" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42671 } }
I20260615 08:05:25.627671 7729 ts_tablet_manager.cc:1434] T ac7682543d094ecbbf811d337601352b P 33a7dd35d8a14b78a5c1da94de967166: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260615 08:05:25.627715 7713 heartbeater.cc:499] Master 127.4.42.254:36481 was elected leader, sending a full tablet report...
I20260615 08:05:25.627785 7734 tablet_bootstrap.cc:492] T ac7682543d094ecbbf811d337601352b P 21c73d92902045d5b182df2e62bf6f9b: Bootstrap starting.
I20260615 08:05:25.628245 7734 tablet_bootstrap.cc:654] T ac7682543d094ecbbf811d337601352b P 21c73d92902045d5b182df2e62bf6f9b: Neither blocks nor log segments found. Creating new log.
I20260615 08:05:25.628800 7734 tablet_bootstrap.cc:492] T ac7682543d094ecbbf811d337601352b P 21c73d92902045d5b182df2e62bf6f9b: No bootstrap required, opened a new log
I20260615 08:05:25.628860 7734 ts_tablet_manager.cc:1403] T ac7682543d094ecbbf811d337601352b P 21c73d92902045d5b182df2e62bf6f9b: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:05:25.628999 7734 raft_consensus.cc:359] T ac7682543d094ecbbf811d337601352b P 21c73d92902045d5b182df2e62bf6f9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c73d92902045d5b182df2e62bf6f9b" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33811 } } peers { permanent_uuid: "5bee3b6d130341efb29315ffbd928b7b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 37429 } } peers { permanent_uuid: "33a7dd35d8a14b78a5c1da94de967166" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42671 } }
I20260615 08:05:25.629060 7734 raft_consensus.cc:385] T ac7682543d094ecbbf811d337601352b P 21c73d92902045d5b182df2e62bf6f9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:05:25.629092 7734 raft_consensus.cc:740] T ac7682543d094ecbbf811d337601352b P 21c73d92902045d5b182df2e62bf6f9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c73d92902045d5b182df2e62bf6f9b, State: Initialized, Role: FOLLOWER
I20260615 08:05:25.629160 7734 consensus_queue.cc:260] T ac7682543d094ecbbf811d337601352b P 21c73d92902045d5b182df2e62bf6f9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c73d92902045d5b182df2e62bf6f9b" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33811 } } peers { permanent_uuid: "5bee3b6d130341efb29315ffbd928b7b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 37429 } } peers { permanent_uuid: "33a7dd35d8a14b78a5c1da94de967166" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42671 } }
I20260615 08:05:25.629423 7734 ts_tablet_manager.cc:1434] T ac7682543d094ecbbf811d337601352b P 21c73d92902045d5b182df2e62bf6f9b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:05:25.629464 7562 heartbeater.cc:499] Master 127.4.42.254:36481 was elected leader, sending a full tablet report...
W20260615 08:05:25.827360 7563 tablet.cc:2404] T ac7682543d094ecbbf811d337601352b P 21c73d92902045d5b182df2e62bf6f9b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260615 08:05:26.039975 7736 raft_consensus.cc:493] T ac7682543d094ecbbf811d337601352b P 21c73d92902045d5b182df2e62bf6f9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260615 08:05:26.040088 7736 raft_consensus.cc:515] T ac7682543d094ecbbf811d337601352b P 21c73d92902045d5b182df2e62bf6f9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c73d92902045d5b182df2e62bf6f9b" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33811 } } peers { permanent_uuid: "5bee3b6d130341efb29315ffbd928b7b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 37429 } } peers { permanent_uuid: "33a7dd35d8a14b78a5c1da94de967166" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42671 } }
I20260615 08:05:26.040287 7736 leader_election.cc:290] T ac7682543d094ecbbf811d337601352b P 21c73d92902045d5b182df2e62bf6f9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5bee3b6d130341efb29315ffbd928b7b (127.4.42.194:37429), 33a7dd35d8a14b78a5c1da94de967166 (127.4.42.195:42671)
I20260615 08:05:26.043044 7612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7682543d094ecbbf811d337601352b" candidate_uuid: "21c73d92902045d5b182df2e62bf6f9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bee3b6d130341efb29315ffbd928b7b" is_pre_election: true
I20260615 08:05:26.043128 7612 raft_consensus.cc:2468] T ac7682543d094ecbbf811d337601352b P 5bee3b6d130341efb29315ffbd928b7b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c73d92902045d5b182df2e62bf6f9b in term 0.
I20260615 08:05:26.043157 7687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7682543d094ecbbf811d337601352b" candidate_uuid: "21c73d92902045d5b182df2e62bf6f9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33a7dd35d8a14b78a5c1da94de967166" is_pre_election: true
I20260615 08:05:26.043263 7687 raft_consensus.cc:2468] T ac7682543d094ecbbf811d337601352b P 33a7dd35d8a14b78a5c1da94de967166 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c73d92902045d5b182df2e62bf6f9b in term 0.
I20260615 08:05:26.043339 7502 leader_election.cc:304] T ac7682543d094ecbbf811d337601352b P 21c73d92902045d5b182df2e62bf6f9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c73d92902045d5b182df2e62bf6f9b, 5bee3b6d130341efb29315ffbd928b7b; no voters:
I20260615 08:05:26.043483 7736 raft_consensus.cc:2804] T ac7682543d094ecbbf811d337601352b P 21c73d92902045d5b182df2e62bf6f9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260615 08:05:26.043548 7736 raft_consensus.cc:493] T ac7682543d094ecbbf811d337601352b P 21c73d92902045d5b182df2e62bf6f9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:05:26.043581 7736 raft_consensus.cc:3060] T ac7682543d094ecbbf811d337601352b P 21c73d92902045d5b182df2e62bf6f9b [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:05:26.044202 7736 raft_consensus.cc:515] T ac7682543d094ecbbf811d337601352b P 21c73d92902045d5b182df2e62bf6f9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c73d92902045d5b182df2e62bf6f9b" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33811 } } peers { permanent_uuid: "5bee3b6d130341efb29315ffbd928b7b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 37429 } } peers { permanent_uuid: "33a7dd35d8a14b78a5c1da94de967166" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42671 } }
I20260615 08:05:26.044338 7736 leader_election.cc:290] T ac7682543d094ecbbf811d337601352b P 21c73d92902045d5b182df2e62bf6f9b [CANDIDATE]: Term 1 election: Requested vote from peers 5bee3b6d130341efb29315ffbd928b7b (127.4.42.194:37429), 33a7dd35d8a14b78a5c1da94de967166 (127.4.42.195:42671)
I20260615 08:05:26.044481 7612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7682543d094ecbbf811d337601352b" candidate_uuid: "21c73d92902045d5b182df2e62bf6f9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bee3b6d130341efb29315ffbd928b7b"
I20260615 08:05:26.044497 7687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7682543d094ecbbf811d337601352b" candidate_uuid: "21c73d92902045d5b182df2e62bf6f9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33a7dd35d8a14b78a5c1da94de967166"
I20260615 08:05:26.044569 7612 raft_consensus.cc:3060] T ac7682543d094ecbbf811d337601352b P 5bee3b6d130341efb29315ffbd928b7b [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:05:26.044584 7687 raft_consensus.cc:3060] T ac7682543d094ecbbf811d337601352b P 33a7dd35d8a14b78a5c1da94de967166 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:05:26.045271 7612 raft_consensus.cc:2468] T ac7682543d094ecbbf811d337601352b P 5bee3b6d130341efb29315ffbd928b7b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c73d92902045d5b182df2e62bf6f9b in term 1.
I20260615 08:05:26.045397 7687 raft_consensus.cc:2468] T ac7682543d094ecbbf811d337601352b P 33a7dd35d8a14b78a5c1da94de967166 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c73d92902045d5b182df2e62bf6f9b in term 1.
I20260615 08:05:26.045425 7502 leader_election.cc:304] T ac7682543d094ecbbf811d337601352b P 21c73d92902045d5b182df2e62bf6f9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c73d92902045d5b182df2e62bf6f9b, 5bee3b6d130341efb29315ffbd928b7b; no voters:
I20260615 08:05:26.045495 7736 raft_consensus.cc:2804] T ac7682543d094ecbbf811d337601352b P 21c73d92902045d5b182df2e62bf6f9b [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:05:26.045588 7736 raft_consensus.cc:697] T ac7682543d094ecbbf811d337601352b P 21c73d92902045d5b182df2e62bf6f9b [term 1 LEADER]: Becoming Leader. State: Replica: 21c73d92902045d5b182df2e62bf6f9b, State: Running, Role: LEADER
I20260615 08:05:26.045636 7736 consensus_queue.cc:237] T ac7682543d094ecbbf811d337601352b P 21c73d92902045d5b182df2e62bf6f9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c73d92902045d5b182df2e62bf6f9b" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33811 } } peers { permanent_uuid: "5bee3b6d130341efb29315ffbd928b7b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 37429 } } peers { permanent_uuid: "33a7dd35d8a14b78a5c1da94de967166" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42671 } }
I20260615 08:05:26.046166 7433 catalog_manager.cc:5696] T ac7682543d094ecbbf811d337601352b P 21c73d92902045d5b182df2e62bf6f9b reported cstate change: term changed from 0 to 1, leader changed from <none> to 21c73d92902045d5b182df2e62bf6f9b (127.4.42.193). New cstate: current_term: 1 leader_uuid: "21c73d92902045d5b182df2e62bf6f9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c73d92902045d5b182df2e62bf6f9b" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bee3b6d130341efb29315ffbd928b7b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 37429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "33a7dd35d8a14b78a5c1da94de967166" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42671 } health_report { overall_health: UNKNOWN } } }
I20260615 08:05:26.065111 7687 raft_consensus.cc:1275] T ac7682543d094ecbbf811d337601352b P 33a7dd35d8a14b78a5c1da94de967166 [term 1 FOLLOWER]: Refusing update from remote peer 21c73d92902045d5b182df2e62bf6f9b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:05:26.065235 7612 raft_consensus.cc:1275] T ac7682543d094ecbbf811d337601352b P 5bee3b6d130341efb29315ffbd928b7b [term 1 FOLLOWER]: Refusing update from remote peer 21c73d92902045d5b182df2e62bf6f9b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:05:26.065443 7738 consensus_queue.cc:1048] T ac7682543d094ecbbf811d337601352b P 21c73d92902045d5b182df2e62bf6f9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "33a7dd35d8a14b78a5c1da94de967166" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:05:26.065613 7738 consensus_queue.cc:1048] T ac7682543d094ecbbf811d337601352b P 21c73d92902045d5b182df2e62bf6f9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bee3b6d130341efb29315ffbd928b7b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 37429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260615 08:05:36.072435 7602 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39298: Illegal state: replica 5bee3b6d130341efb29315ffbd928b7b is not leader of this config: current role FOLLOWER
W20260615 08:05:36.072801 7602 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39298: Illegal state: replica 5bee3b6d130341efb29315ffbd928b7b is not leader of this config: current role FOLLOWER
W20260615 08:05:36.073109 7602 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:39298: Illegal state: replica 5bee3b6d130341efb29315ffbd928b7b is not leader of this config: current role FOLLOWER
I20260615 08:05:36.073326 4267 tablet_server.cc:179] TabletServer@127.4.42.193:0 shutting down...
I20260615 08:05:36.076006 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:05:36.076098 4267 tablet_replica.cc:333] T ac7682543d094ecbbf811d337601352b P 21c73d92902045d5b182df2e62bf6f9b: stopping tablet replica
I20260615 08:05:36.076135 4267 raft_consensus.cc:2243] T ac7682543d094ecbbf811d337601352b P 21c73d92902045d5b182df2e62bf6f9b [term 1 LEADER]: Raft consensus shutting down.
I20260615 08:05:36.076211 4267 raft_consensus.cc:2272] T ac7682543d094ecbbf811d337601352b P 21c73d92902045d5b182df2e62bf6f9b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:05:36.090152 4267 tablet_server.cc:196] TabletServer@127.4.42.193:0 shutdown complete.
I20260615 08:05:36.090998 4267 tablet_server.cc:179] TabletServer@127.4.42.194:0 shutting down...
I20260615 08:05:36.094105 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:05:36.094266 4267 tablet_replica.cc:333] T ac7682543d094ecbbf811d337601352b P 5bee3b6d130341efb29315ffbd928b7b: stopping tablet replica
I20260615 08:05:36.094323 4267 raft_consensus.cc:2243] T ac7682543d094ecbbf811d337601352b P 5bee3b6d130341efb29315ffbd928b7b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260615 08:05:36.094369 4267 raft_consensus.cc:2272] T ac7682543d094ecbbf811d337601352b P 5bee3b6d130341efb29315ffbd928b7b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:05:36.115947 4267 tablet_server.cc:196] TabletServer@127.4.42.194:0 shutdown complete.
I20260615 08:05:36.116765 4267 tablet_server.cc:179] TabletServer@127.4.42.195:0 shutting down...
I20260615 08:05:36.119385 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:05:36.119526 4267 tablet_replica.cc:333] T ac7682543d094ecbbf811d337601352b P 33a7dd35d8a14b78a5c1da94de967166: stopping tablet replica
I20260615 08:05:36.119578 4267 raft_consensus.cc:2243] T ac7682543d094ecbbf811d337601352b P 33a7dd35d8a14b78a5c1da94de967166 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260615 08:05:36.119626 4267 raft_consensus.cc:2272] T ac7682543d094ecbbf811d337601352b P 33a7dd35d8a14b78a5c1da94de967166 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:05:36.133186 4267 tablet_server.cc:196] TabletServer@127.4.42.195:0 shutdown complete.
I20260615 08:05:36.134006 4267 master.cc:562] Master@127.4.42.254:36481 shutting down...
I20260615 08:05:36.136670 4267 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c1fb8ad8ec6f402ab9859f2042e6fbde [term 1 LEADER]: Raft consensus shutting down.
I20260615 08:05:36.136723 4267 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c1fb8ad8ec6f402ab9859f2042e6fbde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:05:36.136740 4267 tablet_replica.cc:333] T 00000000000000000000000000000000 P c1fb8ad8ec6f402ab9859f2042e6fbde: stopping tablet replica
I20260615 08:05:36.148201 4267 master.cc:584] Master@127.4.42.254:36481 shutdown complete.
[ OK ] TxnParticipantITest.TestProxyNonLeader (10674 ms)
[ RUN ] TxnParticipantITest.TestProxyTabletBootstrapping
I20260615 08:05:36.166365 4267 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.42.254:43169
I20260615 08:05:36.166543 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:05:36.167587 7777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:05:36.167630 7780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:05:36.167693 7778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:05:36.167713 4267 server_base.cc:1061] running on GCE node
I20260615 08:05:36.167840 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:05:36.167912 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:05:36.167935 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510736167935 us; error 0 us; skew 500 ppm
I20260615 08:05:36.168502 4267 webserver.cc:533] Webserver started at http://127.4.42.254:39935/ using document root <none> and password file <none>
I20260615 08:05:36.168593 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:05:36.168639 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:05:36.168689 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:05:36.168962 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1781510637089012-4267-0/minicluster-data/master-0-root/instance:
uuid: "101257707ed743898364c42e41636140"
format_stamp: "Formatted at 2026-06-15 08:05:36 on dist-test-slave-37n8"
I20260615 08:05:36.169900 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:05:36.170352 7785 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:36.170477 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:36.170563 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1781510637089012-4267-0/minicluster-data/master-0-root
uuid: "101257707ed743898364c42e41636140"
format_stamp: "Formatted at 2026-06-15 08:05:36 on dist-test-slave-37n8"
I20260615 08:05:36.170608 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1781510637089012-4267-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1781510637089012-4267-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1781510637089012-4267-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:05:36.176400 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:05:36.176574 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:05:36.179374 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.254:43169
I20260615 08:05:36.190932 7837 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.254:43169 every 8 connection(s)
I20260615 08:05:36.191037 7838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:05:36.191947 7838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 101257707ed743898364c42e41636140: Bootstrap starting.
I20260615 08:05:36.192190 7838 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 101257707ed743898364c42e41636140: Neither blocks nor log segments found. Creating new log.
I20260615 08:05:36.192586 7838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 101257707ed743898364c42e41636140: No bootstrap required, opened a new log
I20260615 08:05:36.192683 7838 raft_consensus.cc:359] T 00000000000000000000000000000000 P 101257707ed743898364c42e41636140 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101257707ed743898364c42e41636140" member_type: VOTER }
I20260615 08:05:36.192723 7838 raft_consensus.cc:385] T 00000000000000000000000000000000 P 101257707ed743898364c42e41636140 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:05:36.192736 7838 raft_consensus.cc:740] T 00000000000000000000000000000000 P 101257707ed743898364c42e41636140 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 101257707ed743898364c42e41636140, State: Initialized, Role: FOLLOWER
I20260615 08:05:36.192795 7838 consensus_queue.cc:260] T 00000000000000000000000000000000 P 101257707ed743898364c42e41636140 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101257707ed743898364c42e41636140" member_type: VOTER }
I20260615 08:05:36.192837 7838 raft_consensus.cc:399] T 00000000000000000000000000000000 P 101257707ed743898364c42e41636140 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260615 08:05:36.192857 7838 raft_consensus.cc:493] T 00000000000000000000000000000000 P 101257707ed743898364c42e41636140 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260615 08:05:36.192890 7838 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 101257707ed743898364c42e41636140 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:05:36.193324 7838 raft_consensus.cc:515] T 00000000000000000000000000000000 P 101257707ed743898364c42e41636140 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101257707ed743898364c42e41636140" member_type: VOTER }
I20260615 08:05:36.193377 7838 leader_election.cc:304] T 00000000000000000000000000000000 P 101257707ed743898364c42e41636140 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 101257707ed743898364c42e41636140; no voters:
I20260615 08:05:36.193481 7838 leader_election.cc:290] T 00000000000000000000000000000000 P 101257707ed743898364c42e41636140 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260615 08:05:36.193531 7841 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 101257707ed743898364c42e41636140 [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:05:36.193629 7838 sys_catalog.cc:565] T 00000000000000000000000000000000 P 101257707ed743898364c42e41636140 [sys.catalog]: configured and running, proceeding with master startup.
I20260615 08:05:36.193640 7841 raft_consensus.cc:697] T 00000000000000000000000000000000 P 101257707ed743898364c42e41636140 [term 1 LEADER]: Becoming Leader. State: Replica: 101257707ed743898364c42e41636140, State: Running, Role: LEADER
I20260615 08:05:36.193706 7841 consensus_queue.cc:237] T 00000000000000000000000000000000 P 101257707ed743898364c42e41636140 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101257707ed743898364c42e41636140" member_type: VOTER }
I20260615 08:05:36.193923 7842 sys_catalog.cc:455] T 00000000000000000000000000000000 P 101257707ed743898364c42e41636140 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "101257707ed743898364c42e41636140" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101257707ed743898364c42e41636140" member_type: VOTER } }
I20260615 08:05:36.194046 7842 sys_catalog.cc:458] T 00000000000000000000000000000000 P 101257707ed743898364c42e41636140 [sys.catalog]: This master's current role is: LEADER
I20260615 08:05:36.193933 7843 sys_catalog.cc:455] T 00000000000000000000000000000000 P 101257707ed743898364c42e41636140 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 101257707ed743898364c42e41636140. Latest consensus state: current_term: 1 leader_uuid: "101257707ed743898364c42e41636140" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101257707ed743898364c42e41636140" member_type: VOTER } }
I20260615 08:05:36.194224 7843 sys_catalog.cc:458] T 00000000000000000000000000000000 P 101257707ed743898364c42e41636140 [sys.catalog]: This master's current role is: LEADER
I20260615 08:05:36.194337 7847 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260615 08:05:36.194475 7847 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260615 08:05:36.195093 4267 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260615 08:05:36.195132 7847 catalog_manager.cc:1382] Generated new cluster ID: e1975e119f6643dd8ad090ccd23d137c
I20260615 08:05:36.195166 7847 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260615 08:05:36.209491 7847 catalog_manager.cc:1405] Generated new certificate authority record
I20260615 08:05:36.209928 7847 catalog_manager.cc:1539] Loading token signing keys...
I20260615 08:05:36.237097 7847 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 101257707ed743898364c42e41636140: Generated new TSK 0
I20260615 08:05:36.237193 7847 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260615 08:05:36.258970 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:05:36.260247 7860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:05:36.260283 4267 server_base.cc:1061] running on GCE node
W20260615 08:05:36.260378 7862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:05:36.260322 7859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:05:36.260517 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:05:36.260569 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:05:36.260589 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510736260589 us; error 0 us; skew 500 ppm
I20260615 08:05:36.261152 4267 webserver.cc:533] Webserver started at http://127.4.42.193:36969/ using document root <none> and password file <none>
I20260615 08:05:36.261251 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:05:36.261307 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:05:36.261358 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:05:36.261622 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1781510637089012-4267-0/minicluster-data/ts-0-root/instance:
uuid: "64011685df0f4994949aa9af117ff8a2"
format_stamp: "Formatted at 2026-06-15 08:05:36 on dist-test-slave-37n8"
I20260615 08:05:36.262553 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:05:36.263015 7867 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:36.263146 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:36.263201 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1781510637089012-4267-0/minicluster-data/ts-0-root
uuid: "64011685df0f4994949aa9af117ff8a2"
format_stamp: "Formatted at 2026-06-15 08:05:36 on dist-test-slave-37n8"
I20260615 08:05:36.263247 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1781510637089012-4267-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1781510637089012-4267-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1781510637089012-4267-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:05:36.280555 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:05:36.280751 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:05:36.280901 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:05:36.281088 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:05:36.281131 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:36.281169 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:05:36.281194 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:36.284032 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.193:33765
I20260615 08:05:36.284060 7930 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.193:33765 every 8 connection(s)
I20260615 08:05:36.284446 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:05:36.285523 7935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:05:36.285575 7936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:05:36.285689 7938 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:05:36.285822 4267 server_base.cc:1061] running on GCE node
I20260615 08:05:36.286012 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:05:36.286063 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:05:36.286085 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510736286085 us; error 0 us; skew 500 ppm
I20260615 08:05:36.286695 4267 webserver.cc:533] Webserver started at http://127.4.42.194:40897/ using document root <none> and password file <none>
I20260615 08:05:36.286782 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:05:36.286823 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:05:36.286864 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:05:36.287132 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1781510637089012-4267-0/minicluster-data/ts-1-root/instance:
uuid: "332931d57e51445da80d8657f12a6d5b"
format_stamp: "Formatted at 2026-06-15 08:05:36 on dist-test-slave-37n8"
I20260615 08:05:36.288295 7931 heartbeater.cc:344] Connected to a master server at 127.4.42.254:43169
I20260615 08:05:36.288308 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:05:36.288357 7931 heartbeater.cc:461] Registering TS with master...
I20260615 08:05:36.288458 7931 heartbeater.cc:507] Master 127.4.42.254:43169 requested a full tablet report, sending...
I20260615 08:05:36.288681 7802 ts_manager.cc:194] Registered new tserver with Master: 64011685df0f4994949aa9af117ff8a2 (127.4.42.193:33765)
I20260615 08:05:36.288856 7943 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:36.288972 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:36.289016 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1781510637089012-4267-0/minicluster-data/ts-1-root
uuid: "332931d57e51445da80d8657f12a6d5b"
format_stamp: "Formatted at 2026-06-15 08:05:36 on dist-test-slave-37n8"
I20260615 08:05:36.289057 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1781510637089012-4267-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1781510637089012-4267-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1781510637089012-4267-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:05:36.289387 7802 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40724
I20260615 08:05:36.292359 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:05:36.292490 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:05:36.292586 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:05:36.292721 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:05:36.292743 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:36.292763 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:05:36.292785 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:36.295624 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.194:38987
I20260615 08:05:36.295668 8006 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.194:38987 every 8 connection(s)
I20260615 08:05:36.295957 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:05:36.297041 8010 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:05:36.297120 8011 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:05:36.297225 4267 server_base.cc:1061] running on GCE node
W20260615 08:05:36.297353 8013 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:05:36.297495 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:05:36.297529 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:05:36.297542 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510736297543 us; error 0 us; skew 500 ppm
I20260615 08:05:36.298007 4267 webserver.cc:533] Webserver started at http://127.4.42.195:41233/ using document root <none> and password file <none>
I20260615 08:05:36.298100 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:05:36.298144 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:05:36.298190 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:05:36.298460 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1781510637089012-4267-0/minicluster-data/ts-2-root/instance:
uuid: "9a41d02cded84901a048957bbae444da"
format_stamp: "Formatted at 2026-06-15 08:05:36 on dist-test-slave-37n8"
I20260615 08:05:36.299206 8007 heartbeater.cc:344] Connected to a master server at 127.4.42.254:43169
I20260615 08:05:36.299265 8007 heartbeater.cc:461] Registering TS with master...
I20260615 08:05:36.299376 8007 heartbeater.cc:507] Master 127.4.42.254:43169 requested a full tablet report, sending...
I20260615 08:05:36.299474 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:05:36.299571 7802 ts_manager.cc:194] Registered new tserver with Master: 332931d57e51445da80d8657f12a6d5b (127.4.42.194:38987)
I20260615 08:05:36.299974 8018 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:36.300024 7802 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40734
I20260615 08:05:36.300173 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:36.300232 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1781510637089012-4267-0/minicluster-data/ts-2-root
uuid: "9a41d02cded84901a048957bbae444da"
format_stamp: "Formatted at 2026-06-15 08:05:36 on dist-test-slave-37n8"
I20260615 08:05:36.300288 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1781510637089012-4267-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1781510637089012-4267-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1781510637089012-4267-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:05:36.353207 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:05:36.353483 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:05:36.353669 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:05:36.353884 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:05:36.353929 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:36.353969 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:05:36.353998 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:36.357386 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.195:38585
I20260615 08:05:36.357483 8081 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.195:38585 every 8 connection(s)
I20260615 08:05:36.360447 8082 heartbeater.cc:344] Connected to a master server at 127.4.42.254:43169
I20260615 08:05:36.360509 8082 heartbeater.cc:461] Registering TS with master...
I20260615 08:05:36.360616 8082 heartbeater.cc:507] Master 127.4.42.254:43169 requested a full tablet report, sending...
I20260615 08:05:36.360881 7802 ts_manager.cc:194] Registered new tserver with Master: 9a41d02cded84901a048957bbae444da (127.4.42.195:38585)
I20260615 08:05:36.360957 4267 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003340601s
I20260615 08:05:36.361251 7802 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40736
I20260615 08:05:36.365658 7802 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40740:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260615 08:05:36.365796 7802 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260615 08:05:36.370306 7895 tablet_service.cc:1511] Processing CreateTablet for tablet 0bb189934ea04e02ba33b6ce419d6c19 (DEFAULT_TABLE table=test-workload [id=0450090f4b07466899cfaa4bdcefbddf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:05:36.370427 7895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bb189934ea04e02ba33b6ce419d6c19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:05:36.370671 8046 tablet_service.cc:1511] Processing CreateTablet for tablet 0bb189934ea04e02ba33b6ce419d6c19 (DEFAULT_TABLE table=test-workload [id=0450090f4b07466899cfaa4bdcefbddf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:05:36.370738 7971 tablet_service.cc:1511] Processing CreateTablet for tablet 0bb189934ea04e02ba33b6ce419d6c19 (DEFAULT_TABLE table=test-workload [id=0450090f4b07466899cfaa4bdcefbddf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:05:36.370783 8046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bb189934ea04e02ba33b6ce419d6c19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:05:36.370812 7971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bb189934ea04e02ba33b6ce419d6c19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:05:36.371733 8097 tablet_bootstrap.cc:492] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2: Bootstrap starting.
I20260615 08:05:36.372234 8097 tablet_bootstrap.cc:654] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2: Neither blocks nor log segments found. Creating new log.
I20260615 08:05:36.372241 8099 tablet_bootstrap.cc:492] T 0bb189934ea04e02ba33b6ce419d6c19 P 9a41d02cded84901a048957bbae444da: Bootstrap starting.
I20260615 08:05:36.372246 8098 tablet_bootstrap.cc:492] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b: Bootstrap starting.
I20260615 08:05:36.372768 8098 tablet_bootstrap.cc:654] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b: Neither blocks nor log segments found. Creating new log.
I20260615 08:05:36.372772 8099 tablet_bootstrap.cc:654] T 0bb189934ea04e02ba33b6ce419d6c19 P 9a41d02cded84901a048957bbae444da: Neither blocks nor log segments found. Creating new log.
I20260615 08:05:36.373443 8097 tablet_bootstrap.cc:492] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2: No bootstrap required, opened a new log
I20260615 08:05:36.373482 8097 ts_tablet_manager.cc:1403] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260615 08:05:36.373484 8098 tablet_bootstrap.cc:492] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b: No bootstrap required, opened a new log
I20260615 08:05:36.373514 8099 tablet_bootstrap.cc:492] T 0bb189934ea04e02ba33b6ce419d6c19 P 9a41d02cded84901a048957bbae444da: No bootstrap required, opened a new log
I20260615 08:05:36.373601 8098 ts_tablet_manager.cc:1403] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:05:36.373620 8099 ts_tablet_manager.cc:1403] T 0bb189934ea04e02ba33b6ce419d6c19 P 9a41d02cded84901a048957bbae444da: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:05:36.373678 8097 raft_consensus.cc:359] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a41d02cded84901a048957bbae444da" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 38585 } } peers { permanent_uuid: "64011685df0f4994949aa9af117ff8a2" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33765 } } peers { permanent_uuid: "332931d57e51445da80d8657f12a6d5b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38987 } }
I20260615 08:05:36.373746 8097 raft_consensus.cc:385] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:05:36.373769 8097 raft_consensus.cc:740] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64011685df0f4994949aa9af117ff8a2, State: Initialized, Role: FOLLOWER
I20260615 08:05:36.373764 8099 raft_consensus.cc:359] T 0bb189934ea04e02ba33b6ce419d6c19 P 9a41d02cded84901a048957bbae444da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a41d02cded84901a048957bbae444da" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 38585 } } peers { permanent_uuid: "64011685df0f4994949aa9af117ff8a2" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33765 } } peers { permanent_uuid: "332931d57e51445da80d8657f12a6d5b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38987 } }
I20260615 08:05:36.373782 8098 raft_consensus.cc:359] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a41d02cded84901a048957bbae444da" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 38585 } } peers { permanent_uuid: "64011685df0f4994949aa9af117ff8a2" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33765 } } peers { permanent_uuid: "332931d57e51445da80d8657f12a6d5b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38987 } }
I20260615 08:05:36.373860 8099 raft_consensus.cc:385] T 0bb189934ea04e02ba33b6ce419d6c19 P 9a41d02cded84901a048957bbae444da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:05:36.373875 8098 raft_consensus.cc:385] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:05:36.373888 8099 raft_consensus.cc:740] T 0bb189934ea04e02ba33b6ce419d6c19 P 9a41d02cded84901a048957bbae444da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a41d02cded84901a048957bbae444da, State: Initialized, Role: FOLLOWER
I20260615 08:05:36.373885 8097 consensus_queue.cc:260] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a41d02cded84901a048957bbae444da" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 38585 } } peers { permanent_uuid: "64011685df0f4994949aa9af117ff8a2" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33765 } } peers { permanent_uuid: "332931d57e51445da80d8657f12a6d5b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38987 } }
I20260615 08:05:36.373961 8098 raft_consensus.cc:740] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 332931d57e51445da80d8657f12a6d5b, State: Initialized, Role: FOLLOWER
I20260615 08:05:36.374015 8099 consensus_queue.cc:260] T 0bb189934ea04e02ba33b6ce419d6c19 P 9a41d02cded84901a048957bbae444da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a41d02cded84901a048957bbae444da" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 38585 } } peers { permanent_uuid: "64011685df0f4994949aa9af117ff8a2" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33765 } } peers { permanent_uuid: "332931d57e51445da80d8657f12a6d5b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38987 } }
I20260615 08:05:36.374034 8098 consensus_queue.cc:260] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a41d02cded84901a048957bbae444da" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 38585 } } peers { permanent_uuid: "64011685df0f4994949aa9af117ff8a2" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33765 } } peers { permanent_uuid: "332931d57e51445da80d8657f12a6d5b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38987 } }
I20260615 08:05:36.374104 8097 ts_tablet_manager.cc:1434] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260615 08:05:36.374154 8099 ts_tablet_manager.cc:1434] T 0bb189934ea04e02ba33b6ce419d6c19 P 9a41d02cded84901a048957bbae444da: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:05:36.374223 8098 ts_tablet_manager.cc:1434] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:05:36.374260 8082 heartbeater.cc:499] Master 127.4.42.254:43169 was elected leader, sending a full tablet report...
I20260615 08:05:36.374195 7931 heartbeater.cc:499] Master 127.4.42.254:43169 was elected leader, sending a full tablet report...
I20260615 08:05:36.374330 8007 heartbeater.cc:499] Master 127.4.42.254:43169 was elected leader, sending a full tablet report...
I20260615 08:05:36.392571 8105 raft_consensus.cc:493] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260615 08:05:36.392629 8105 raft_consensus.cc:515] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a41d02cded84901a048957bbae444da" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 38585 } } peers { permanent_uuid: "64011685df0f4994949aa9af117ff8a2" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33765 } } peers { permanent_uuid: "332931d57e51445da80d8657f12a6d5b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38987 } }
I20260615 08:05:36.392784 8105 leader_election.cc:290] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a41d02cded84901a048957bbae444da (127.4.42.195:38585), 64011685df0f4994949aa9af117ff8a2 (127.4.42.193:33765)
I20260615 08:05:36.395396 8056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb189934ea04e02ba33b6ce419d6c19" candidate_uuid: "332931d57e51445da80d8657f12a6d5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a41d02cded84901a048957bbae444da" is_pre_election: true
I20260615 08:05:36.395485 8056 raft_consensus.cc:2468] T 0bb189934ea04e02ba33b6ce419d6c19 P 9a41d02cded84901a048957bbae444da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 332931d57e51445da80d8657f12a6d5b in term 0.
I20260615 08:05:36.395454 7905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb189934ea04e02ba33b6ce419d6c19" candidate_uuid: "332931d57e51445da80d8657f12a6d5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64011685df0f4994949aa9af117ff8a2" is_pre_election: true
I20260615 08:05:36.395561 7905 raft_consensus.cc:2468] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 332931d57e51445da80d8657f12a6d5b in term 0.
I20260615 08:05:36.395640 7947 leader_election.cc:304] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 332931d57e51445da80d8657f12a6d5b, 9a41d02cded84901a048957bbae444da; no voters:
I20260615 08:05:36.395720 8105 raft_consensus.cc:2804] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260615 08:05:36.395766 8105 raft_consensus.cc:493] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:05:36.395797 8105 raft_consensus.cc:3060] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:05:36.396364 8105 raft_consensus.cc:515] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a41d02cded84901a048957bbae444da" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 38585 } } peers { permanent_uuid: "64011685df0f4994949aa9af117ff8a2" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33765 } } peers { permanent_uuid: "332931d57e51445da80d8657f12a6d5b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38987 } }
I20260615 08:05:36.396507 8105 leader_election.cc:290] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b [CANDIDATE]: Term 1 election: Requested vote from peers 9a41d02cded84901a048957bbae444da (127.4.42.195:38585), 64011685df0f4994949aa9af117ff8a2 (127.4.42.193:33765)
I20260615 08:05:36.396643 8056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb189934ea04e02ba33b6ce419d6c19" candidate_uuid: "332931d57e51445da80d8657f12a6d5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a41d02cded84901a048957bbae444da"
I20260615 08:05:36.396703 7905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb189934ea04e02ba33b6ce419d6c19" candidate_uuid: "332931d57e51445da80d8657f12a6d5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64011685df0f4994949aa9af117ff8a2"
I20260615 08:05:36.396705 8056 raft_consensus.cc:3060] T 0bb189934ea04e02ba33b6ce419d6c19 P 9a41d02cded84901a048957bbae444da [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:05:36.396765 7905 raft_consensus.cc:3060] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:05:36.397385 8056 raft_consensus.cc:2468] T 0bb189934ea04e02ba33b6ce419d6c19 P 9a41d02cded84901a048957bbae444da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 332931d57e51445da80d8657f12a6d5b in term 1.
I20260615 08:05:36.397385 7905 raft_consensus.cc:2468] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 332931d57e51445da80d8657f12a6d5b in term 1.
I20260615 08:05:36.397571 7947 leader_election.cc:304] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 332931d57e51445da80d8657f12a6d5b, 9a41d02cded84901a048957bbae444da; no voters:
I20260615 08:05:36.397665 8105 raft_consensus.cc:2804] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:05:36.397805 8105 raft_consensus.cc:697] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b [term 1 LEADER]: Becoming Leader. State: Replica: 332931d57e51445da80d8657f12a6d5b, State: Running, Role: LEADER
I20260615 08:05:36.397872 8105 consensus_queue.cc:237] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a41d02cded84901a048957bbae444da" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 38585 } } peers { permanent_uuid: "64011685df0f4994949aa9af117ff8a2" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33765 } } peers { permanent_uuid: "332931d57e51445da80d8657f12a6d5b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38987 } }
I20260615 08:05:36.398383 7800 catalog_manager.cc:5696] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b reported cstate change: term changed from 0 to 1, leader changed from <none> to 332931d57e51445da80d8657f12a6d5b (127.4.42.194). New cstate: current_term: 1 leader_uuid: "332931d57e51445da80d8657f12a6d5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a41d02cded84901a048957bbae444da" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 38585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64011685df0f4994949aa9af117ff8a2" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "332931d57e51445da80d8657f12a6d5b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38987 } health_report { overall_health: HEALTHY } } }
I20260615 08:05:36.410820 7905 raft_consensus.cc:1275] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2 [term 1 FOLLOWER]: Refusing update from remote peer 332931d57e51445da80d8657f12a6d5b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:05:36.410848 8056 raft_consensus.cc:1275] T 0bb189934ea04e02ba33b6ce419d6c19 P 9a41d02cded84901a048957bbae444da [term 1 FOLLOWER]: Refusing update from remote peer 332931d57e51445da80d8657f12a6d5b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:05:36.411024 8107 consensus_queue.cc:1048] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a41d02cded84901a048957bbae444da" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 38585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:05:36.411099 8105 consensus_queue.cc:1048] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "64011685df0f4994949aa9af117ff8a2" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:05:46.822014 8130 raft_consensus.cc:993] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b: : Instructing follower 64011685df0f4994949aa9af117ff8a2 to start an election
I20260615 08:05:46.822111 8130 raft_consensus.cc:1081] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b [term 1 LEADER]: Signalling peer 64011685df0f4994949aa9af117ff8a2 to start an election
I20260615 08:05:46.822336 7905 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0bb189934ea04e02ba33b6ce419d6c19"
dest_uuid: "64011685df0f4994949aa9af117ff8a2"
from {username='slave'} at 127.0.0.1:60570
I20260615 08:05:46.822404 7905 raft_consensus.cc:493] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260615 08:05:46.822424 7905 raft_consensus.cc:3060] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2 [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:05:46.823086 7905 raft_consensus.cc:515] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a41d02cded84901a048957bbae444da" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 38585 } } peers { permanent_uuid: "64011685df0f4994949aa9af117ff8a2" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33765 } } peers { permanent_uuid: "332931d57e51445da80d8657f12a6d5b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38987 } }
I20260615 08:05:46.823268 7905 leader_election.cc:290] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2 [CANDIDATE]: Term 2 election: Requested vote from peers 9a41d02cded84901a048957bbae444da (127.4.42.195:38585), 332931d57e51445da80d8657f12a6d5b (127.4.42.194:38987)
I20260615 08:05:46.826773 7981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb189934ea04e02ba33b6ce419d6c19" candidate_uuid: "64011685df0f4994949aa9af117ff8a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 13649 } } ignore_live_leader: true dest_uuid: "332931d57e51445da80d8657f12a6d5b"
I20260615 08:05:46.826787 8055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bb189934ea04e02ba33b6ce419d6c19" candidate_uuid: "64011685df0f4994949aa9af117ff8a2" candidate_term: 2 candidate_status { last_received { term: 1 index: 13649 } } ignore_live_leader: true dest_uuid: "9a41d02cded84901a048957bbae444da"
I20260615 08:05:46.826869 7981 raft_consensus.cc:3055] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b [term 1 LEADER]: Stepping down as leader of term 1
I20260615 08:05:46.826877 8055 raft_consensus.cc:3060] T 0bb189934ea04e02ba33b6ce419d6c19 P 9a41d02cded84901a048957bbae444da [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:05:46.826915 7981 raft_consensus.cc:740] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 332931d57e51445da80d8657f12a6d5b, State: Running, Role: LEADER
I20260615 08:05:46.827008 7981 consensus_queue.cc:260] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13649, Committed index: 13649, Last appended: 1.13649, Last appended by leader: 13649, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a41d02cded84901a048957bbae444da" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 38585 } } peers { permanent_uuid: "64011685df0f4994949aa9af117ff8a2" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33765 } } peers { permanent_uuid: "332931d57e51445da80d8657f12a6d5b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38987 } }
I20260615 08:05:46.827111 7981 raft_consensus.cc:3060] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:05:46.827548 8055 raft_consensus.cc:2468] T 0bb189934ea04e02ba33b6ce419d6c19 P 9a41d02cded84901a048957bbae444da [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64011685df0f4994949aa9af117ff8a2 in term 2.
I20260615 08:05:46.827733 7871 leader_election.cc:304] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64011685df0f4994949aa9af117ff8a2, 9a41d02cded84901a048957bbae444da; no voters:
I20260615 08:05:46.827764 7981 raft_consensus.cc:2468] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64011685df0f4994949aa9af117ff8a2 in term 2.
I20260615 08:05:46.827989 8152 raft_consensus.cc:2804] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2 [term 2 FOLLOWER]: Leader election won for term 2
I20260615 08:05:46.828102 8152 raft_consensus.cc:697] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2 [term 2 LEADER]: Becoming Leader. State: Replica: 64011685df0f4994949aa9af117ff8a2, State: Running, Role: LEADER
I20260615 08:05:46.828156 8152 consensus_queue.cc:237] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13649, Committed index: 13649, Last appended: 1.13649, Last appended by leader: 13649, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a41d02cded84901a048957bbae444da" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 38585 } } peers { permanent_uuid: "64011685df0f4994949aa9af117ff8a2" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33765 } } peers { permanent_uuid: "332931d57e51445da80d8657f12a6d5b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38987 } }
I20260615 08:05:46.828612 7801 catalog_manager.cc:5696] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2 reported cstate change: term changed from 1 to 2, leader changed from 332931d57e51445da80d8657f12a6d5b (127.4.42.194) to 64011685df0f4994949aa9af117ff8a2 (127.4.42.193). New cstate: current_term: 2 leader_uuid: "64011685df0f4994949aa9af117ff8a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a41d02cded84901a048957bbae444da" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 38585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64011685df0f4994949aa9af117ff8a2" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "332931d57e51445da80d8657f12a6d5b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38987 } health_report { overall_health: UNKNOWN } } }
I20260615 08:05:46.829021 4267 tablet_server.cc:179] TabletServer@127.4.42.193:0 shutting down...
I20260615 08:05:46.831540 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:05:46.831643 4267 tablet_replica.cc:333] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2: stopping tablet replica
I20260615 08:05:46.831709 4267 raft_consensus.cc:2243] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2 [term 2 LEADER]: Raft consensus shutting down.
I20260615 08:05:46.831784 4267 pending_rounds.cc:70] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2: Trying to abort 1 pending ops.
I20260615 08:05:46.831844 4267 pending_rounds.cc:77] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2: Aborting op as it isn't in flight: id { term: 2 index: 13650 } timestamp: 7297068019008610304 op_type: NO_OP noop_request { }
I20260615 08:05:46.831894 4267 raft_consensus.cc:2889] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260615 08:05:46.831947 4267 raft_consensus.cc:2272] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:05:46.837208 4267 tablet_server.cc:196] TabletServer@127.4.42.193:0 shutdown complete.
I20260615 08:05:46.838020 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:05:46.839320 8159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:05:46.839319 8158 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:05:46.839491 4267 server_base.cc:1061] running on GCE node
W20260615 08:05:46.839360 8161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:05:46.839632 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:05:46.839679 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:05:46.839720 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510746839719 us; error 0 us; skew 500 ppm
I20260615 08:05:46.840373 4267 webserver.cc:533] Webserver started at http://127.4.42.193:36969/ using document root <none> and password file <none>
I20260615 08:05:46.840471 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:05:46.840507 4267 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260615 08:05:46.841064 4267 fs_manager.cc:714] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:46.841538 8166 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:46.841681 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:46.841738 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1781510637089012-4267-0/minicluster-data/ts-0-root
uuid: "64011685df0f4994949aa9af117ff8a2"
format_stamp: "Formatted at 2026-06-15 08:05:36 on dist-test-slave-37n8"
I20260615 08:05:46.841784 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1781510637089012-4267-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1781510637089012-4267-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletBootstrapping.1781510637089012-4267-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:05:46.868214 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:05:46.868424 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:05:46.868556 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:05:46.868830 8173 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260615 08:05:46.869448 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260615 08:05:46.869508 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20260615 08:05:46.869567 4267 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260615 08:05:46.869957 4267 ts_tablet_manager.cc:616] Registered 1 tablets
W20260615 08:05:46.869974 8173 ts_tablet_manager.cc:1382] Injecting 1000ms delay in tablet bootstrapping
I20260615 08:05:46.870007 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:46.872857 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.193:33765
I20260615 08:05:46.875129 8230 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.193:33765 every 8 connection(s)
I20260615 08:05:46.880290 8231 heartbeater.cc:344] Connected to a master server at 127.4.42.254:43169
I20260615 08:05:46.880367 8231 heartbeater.cc:461] Registering TS with master...
I20260615 08:05:46.880502 8231 heartbeater.cc:507] Master 127.4.42.254:43169 requested a full tablet report, sending...
I20260615 08:05:46.880743 7801 ts_manager.cc:194] Re-registered known tserver with Master: 64011685df0f4994949aa9af117ff8a2 (127.4.42.193:33765)
I20260615 08:05:46.881139 7801 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47054
I20260615 08:05:46.881584 4267 tablet_server.cc:179] TabletServer@127.4.42.193:33765 shutting down...
I20260615 08:05:46.884064 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:05:47.870178 8173 tablet_bootstrap.cc:492] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2: Bootstrap starting.
I20260615 08:05:48.623641 8173 tablet_bootstrap.cc:492] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2: Bootstrap replayed 1/3 log segments. Stats: ops{read=4978 overwritten=0 applied=4976 ignored=0} inserts{seen=248750 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates
W20260615 08:05:48.854429 8237 raft_consensus.cc:670] T 0bb189934ea04e02ba33b6ce419d6c19 P 9a41d02cded84901a048957bbae444da: failed to trigger leader election: Illegal state: leader elections are disabled
I20260615 08:05:49.478863 8173 tablet_bootstrap.cc:492] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2: Bootstrap replayed 2/3 log segments. Stats: ops{read=9938 overwritten=0 applied=9937 ignored=0} inserts{seen=496800 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260615 08:05:50.114199 8173 tablet_bootstrap.cc:492] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2: Bootstrap replayed 3/3 log segments. Stats: ops{read=13650 overwritten=0 applied=13649 ignored=0} inserts{seen=682400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260615 08:05:50.114758 8173 tablet_bootstrap.cc:492] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2: Bootstrap complete.
I20260615 08:05:50.119354 8173 ts_tablet_manager.cc:1403] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2: Time spent bootstrapping tablet: real 2.249s user 1.934s sys 0.308s
I20260615 08:05:50.119491 8173 raft_consensus.cc:359] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2 [term 2 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a41d02cded84901a048957bbae444da" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 38585 } } peers { permanent_uuid: "64011685df0f4994949aa9af117ff8a2" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33765 } } peers { permanent_uuid: "332931d57e51445da80d8657f12a6d5b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38987 } }
I20260615 08:05:50.119585 8173 raft_consensus.cc:740] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64011685df0f4994949aa9af117ff8a2, State: Initialized, Role: FOLLOWER
I20260615 08:05:50.119643 8173 consensus_queue.cc:260] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13649, Last appended: 2.13650, Last appended by leader: 13650, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a41d02cded84901a048957bbae444da" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 38585 } } peers { permanent_uuid: "64011685df0f4994949aa9af117ff8a2" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33765 } } peers { permanent_uuid: "332931d57e51445da80d8657f12a6d5b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38987 } }
I20260615 08:05:50.119833 8173 ts_tablet_manager.cc:1434] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260615 08:05:50.120004 4267 tablet_replica.cc:333] stopping tablet replica
I20260615 08:05:50.120097 4267 raft_consensus.cc:2243] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260615 08:05:50.120167 4267 pending_rounds.cc:70] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2: Trying to abort 1 pending ops.
I20260615 08:05:50.120208 4267 pending_rounds.cc:77] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2: Aborting op as it isn't in flight: id { term: 2 index: 13650 } timestamp: 7297068019008610304 op_type: NO_OP noop_request { }
I20260615 08:05:50.120251 4267 raft_consensus.cc:2889] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260615 08:05:50.120285 4267 raft_consensus.cc:2272] T 0bb189934ea04e02ba33b6ce419d6c19 P 64011685df0f4994949aa9af117ff8a2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:05:50.133666 4267 tablet_server.cc:196] TabletServer@127.4.42.193:33765 shutdown complete.
I20260615 08:05:50.134544 4267 tablet_server.cc:179] TabletServer@127.4.42.194:0 shutting down...
I20260615 08:05:50.137647 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:05:50.137759 4267 tablet_replica.cc:333] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b: stopping tablet replica
I20260615 08:05:50.137835 4267 raft_consensus.cc:2243] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260615 08:05:50.137878 4267 raft_consensus.cc:2272] T 0bb189934ea04e02ba33b6ce419d6c19 P 332931d57e51445da80d8657f12a6d5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:05:50.156816 4267 tablet_server.cc:196] TabletServer@127.4.42.194:0 shutdown complete.
I20260615 08:05:50.157702 4267 tablet_server.cc:179] TabletServer@127.4.42.195:0 shutting down...
I20260615 08:05:50.161226 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:05:50.161334 4267 tablet_replica.cc:333] T 0bb189934ea04e02ba33b6ce419d6c19 P 9a41d02cded84901a048957bbae444da: stopping tablet replica
I20260615 08:05:50.161393 4267 raft_consensus.cc:2243] T 0bb189934ea04e02ba33b6ce419d6c19 P 9a41d02cded84901a048957bbae444da [term 2 FOLLOWER]: Raft consensus shutting down.
I20260615 08:05:50.161459 4267 raft_consensus.cc:2272] T 0bb189934ea04e02ba33b6ce419d6c19 P 9a41d02cded84901a048957bbae444da [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:05:50.174769 4267 tablet_server.cc:196] TabletServer@127.4.42.195:0 shutdown complete.
I20260615 08:05:50.175593 4267 master.cc:562] Master@127.4.42.254:43169 shutting down...
I20260615 08:05:50.178295 4267 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 101257707ed743898364c42e41636140 [term 1 LEADER]: Raft consensus shutting down.
I20260615 08:05:50.178352 4267 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 101257707ed743898364c42e41636140 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:05:50.178370 4267 tablet_replica.cc:333] T 00000000000000000000000000000000 P 101257707ed743898364c42e41636140: stopping tablet replica
I20260615 08:05:50.189895 4267 master.cc:584] Master@127.4.42.254:43169 shutdown complete.
[ OK ] TxnParticipantITest.TestProxyTabletBootstrapping (14042 ms)
[ RUN ] TxnParticipantITest.TestProxyTabletNotRunning
I20260615 08:05:50.208638 4267 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.42.254:38799
I20260615 08:05:50.208775 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:05:50.210069 8241 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:05:50.210237 4267 server_base.cc:1061] running on GCE node
W20260615 08:05:50.210088 8242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:05:50.210095 8244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:05:50.210438 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:05:50.210498 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:05:50.210548 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510750210548 us; error 0 us; skew 500 ppm
I20260615 08:05:50.211053 4267 webserver.cc:533] Webserver started at http://127.4.42.254:33681/ using document root <none> and password file <none>
I20260615 08:05:50.211148 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:05:50.211195 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:05:50.211251 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:05:50.211515 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1781510637089012-4267-0/minicluster-data/master-0-root/instance:
uuid: "645865a9208a41e1bcb1ec3bb8ae8014"
format_stamp: "Formatted at 2026-06-15 08:05:50 on dist-test-slave-37n8"
I20260615 08:05:50.212405 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:05:50.212827 8249 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:50.212954 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:50.213011 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1781510637089012-4267-0/minicluster-data/master-0-root
uuid: "645865a9208a41e1bcb1ec3bb8ae8014"
format_stamp: "Formatted at 2026-06-15 08:05:50 on dist-test-slave-37n8"
I20260615 08:05:50.213057 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1781510637089012-4267-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1781510637089012-4267-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1781510637089012-4267-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:05:50.240505 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:05:50.240710 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:05:50.243316 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.254:38799
I20260615 08:05:50.257961 8301 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.254:38799 every 8 connection(s)
I20260615 08:05:50.258116 8302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:05:50.259173 8302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 645865a9208a41e1bcb1ec3bb8ae8014: Bootstrap starting.
I20260615 08:05:50.259505 8302 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 645865a9208a41e1bcb1ec3bb8ae8014: Neither blocks nor log segments found. Creating new log.
I20260615 08:05:50.260033 8302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 645865a9208a41e1bcb1ec3bb8ae8014: No bootstrap required, opened a new log
I20260615 08:05:50.260174 8302 raft_consensus.cc:359] T 00000000000000000000000000000000 P 645865a9208a41e1bcb1ec3bb8ae8014 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "645865a9208a41e1bcb1ec3bb8ae8014" member_type: VOTER }
I20260615 08:05:50.260221 8302 raft_consensus.cc:385] T 00000000000000000000000000000000 P 645865a9208a41e1bcb1ec3bb8ae8014 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:05:50.260234 8302 raft_consensus.cc:740] T 00000000000000000000000000000000 P 645865a9208a41e1bcb1ec3bb8ae8014 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 645865a9208a41e1bcb1ec3bb8ae8014, State: Initialized, Role: FOLLOWER
I20260615 08:05:50.260300 8302 consensus_queue.cc:260] T 00000000000000000000000000000000 P 645865a9208a41e1bcb1ec3bb8ae8014 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "645865a9208a41e1bcb1ec3bb8ae8014" member_type: VOTER }
I20260615 08:05:50.260339 8302 raft_consensus.cc:399] T 00000000000000000000000000000000 P 645865a9208a41e1bcb1ec3bb8ae8014 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260615 08:05:50.260360 8302 raft_consensus.cc:493] T 00000000000000000000000000000000 P 645865a9208a41e1bcb1ec3bb8ae8014 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260615 08:05:50.260386 8302 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 645865a9208a41e1bcb1ec3bb8ae8014 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:05:50.260850 8302 raft_consensus.cc:515] T 00000000000000000000000000000000 P 645865a9208a41e1bcb1ec3bb8ae8014 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "645865a9208a41e1bcb1ec3bb8ae8014" member_type: VOTER }
I20260615 08:05:50.260902 8302 leader_election.cc:304] T 00000000000000000000000000000000 P 645865a9208a41e1bcb1ec3bb8ae8014 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 645865a9208a41e1bcb1ec3bb8ae8014; no voters:
I20260615 08:05:50.261036 8302 leader_election.cc:290] T 00000000000000000000000000000000 P 645865a9208a41e1bcb1ec3bb8ae8014 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260615 08:05:50.261101 8305 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 645865a9208a41e1bcb1ec3bb8ae8014 [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:05:50.261188 8302 sys_catalog.cc:565] T 00000000000000000000000000000000 P 645865a9208a41e1bcb1ec3bb8ae8014 [sys.catalog]: configured and running, proceeding with master startup.
I20260615 08:05:50.261243 8305 raft_consensus.cc:697] T 00000000000000000000000000000000 P 645865a9208a41e1bcb1ec3bb8ae8014 [term 1 LEADER]: Becoming Leader. State: Replica: 645865a9208a41e1bcb1ec3bb8ae8014, State: Running, Role: LEADER
I20260615 08:05:50.261293 8305 consensus_queue.cc:237] T 00000000000000000000000000000000 P 645865a9208a41e1bcb1ec3bb8ae8014 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "645865a9208a41e1bcb1ec3bb8ae8014" member_type: VOTER }
I20260615 08:05:50.261498 8306 sys_catalog.cc:455] T 00000000000000000000000000000000 P 645865a9208a41e1bcb1ec3bb8ae8014 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "645865a9208a41e1bcb1ec3bb8ae8014" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "645865a9208a41e1bcb1ec3bb8ae8014" member_type: VOTER } }
I20260615 08:05:50.261507 8307 sys_catalog.cc:455] T 00000000000000000000000000000000 P 645865a9208a41e1bcb1ec3bb8ae8014 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 645865a9208a41e1bcb1ec3bb8ae8014. Latest consensus state: current_term: 1 leader_uuid: "645865a9208a41e1bcb1ec3bb8ae8014" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "645865a9208a41e1bcb1ec3bb8ae8014" member_type: VOTER } }
I20260615 08:05:50.261615 8307 sys_catalog.cc:458] T 00000000000000000000000000000000 P 645865a9208a41e1bcb1ec3bb8ae8014 [sys.catalog]: This master's current role is: LEADER
I20260615 08:05:50.261574 8306 sys_catalog.cc:458] T 00000000000000000000000000000000 P 645865a9208a41e1bcb1ec3bb8ae8014 [sys.catalog]: This master's current role is: LEADER
I20260615 08:05:50.261816 8312 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260615 08:05:50.261950 8312 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260615 08:05:50.262539 8312 catalog_manager.cc:1382] Generated new cluster ID: 2c0b9be5cedf420485e8b234201582f0
I20260615 08:05:50.262569 4267 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260615 08:05:50.262593 8312 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260615 08:05:50.274377 8312 catalog_manager.cc:1405] Generated new certificate authority record
I20260615 08:05:50.274822 8312 catalog_manager.cc:1539] Loading token signing keys...
I20260615 08:05:50.281289 8312 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 645865a9208a41e1bcb1ec3bb8ae8014: Generated new TSK 0
I20260615 08:05:50.281378 8312 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260615 08:05:50.294355 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:05:50.295738 8323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:05:50.295795 4267 server_base.cc:1061] running on GCE node
W20260615 08:05:50.295770 8326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:05:50.295871 8324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:05:50.296041 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:05:50.296082 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:05:50.296094 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510750296095 us; error 0 us; skew 500 ppm
I20260615 08:05:50.296725 4267 webserver.cc:533] Webserver started at http://127.4.42.193:45235/ using document root <none> and password file <none>
I20260615 08:05:50.296797 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:05:50.296829 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:05:50.296864 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:05:50.297102 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1781510637089012-4267-0/minicluster-data/ts-0-root/instance:
uuid: "50b55202462e4d38b17b1061ceedaf4f"
format_stamp: "Formatted at 2026-06-15 08:05:50 on dist-test-slave-37n8"
I20260615 08:05:50.297998 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:05:50.298529 8331 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:50.298673 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:50.298725 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1781510637089012-4267-0/minicluster-data/ts-0-root
uuid: "50b55202462e4d38b17b1061ceedaf4f"
format_stamp: "Formatted at 2026-06-15 08:05:50 on dist-test-slave-37n8"
I20260615 08:05:50.298756 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1781510637089012-4267-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1781510637089012-4267-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1781510637089012-4267-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:05:50.312282 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:05:50.312445 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:05:50.312556 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:05:50.312697 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:05:50.312721 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:50.312739 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:05:50.312752 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:50.315523 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.193:39925
I20260615 08:05:50.315555 8394 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.193:39925 every 8 connection(s)
I20260615 08:05:50.315893 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:05:50.316888 8399 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:05:50.317078 8400 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:05:50.317174 8402 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:05:50.317080 4267 server_base.cc:1061] running on GCE node
I20260615 08:05:50.317370 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:05:50.317427 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:05:50.317451 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510750317449 us; error 0 us; skew 500 ppm
I20260615 08:05:50.318037 4267 webserver.cc:533] Webserver started at http://127.4.42.194:34557/ using document root <none> and password file <none>
I20260615 08:05:50.318138 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:05:50.318185 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:05:50.318233 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:05:50.318475 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1781510637089012-4267-0/minicluster-data/ts-1-root/instance:
uuid: "5d3811e4fe7944c18a78fdf4516d3ce9"
format_stamp: "Formatted at 2026-06-15 08:05:50 on dist-test-slave-37n8"
I20260615 08:05:50.319416 8395 heartbeater.cc:344] Connected to a master server at 127.4.42.254:38799
I20260615 08:05:50.319483 8395 heartbeater.cc:461] Registering TS with master...
I20260615 08:05:50.319590 8395 heartbeater.cc:507] Master 127.4.42.254:38799 requested a full tablet report, sending...
I20260615 08:05:50.319701 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:05:50.319854 8266 ts_manager.cc:194] Registered new tserver with Master: 50b55202462e4d38b17b1061ceedaf4f (127.4.42.193:39925)
I20260615 08:05:50.320235 8407 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:50.320348 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260615 08:05:50.320392 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1781510637089012-4267-0/minicluster-data/ts-1-root
uuid: "5d3811e4fe7944c18a78fdf4516d3ce9"
format_stamp: "Formatted at 2026-06-15 08:05:50 on dist-test-slave-37n8"
I20260615 08:05:50.320439 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1781510637089012-4267-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1781510637089012-4267-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1781510637089012-4267-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:05:50.320657 8266 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40362
I20260615 08:05:50.327004 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:05:50.327189 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:05:50.327323 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:05:50.327517 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:05:50.327544 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:50.327562 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:05:50.327575 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:50.330140 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.194:39033
I20260615 08:05:50.330191 8470 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.194:39033 every 8 connection(s)
I20260615 08:05:50.330521 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:05:50.331460 8475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:05:50.331590 8474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:05:50.331714 4267 server_base.cc:1061] running on GCE node
W20260615 08:05:50.331763 8477 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:05:50.332029 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:05:50.332072 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:05:50.332089 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510750332090 us; error 0 us; skew 500 ppm
I20260615 08:05:50.332574 4267 webserver.cc:533] Webserver started at http://127.4.42.195:45819/ using document root <none> and password file <none>
I20260615 08:05:50.332666 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:05:50.332723 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:05:50.332768 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:05:50.333050 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1781510637089012-4267-0/minicluster-data/ts-2-root/instance:
uuid: "be5f9c370e4448cebe281023e15d793a"
format_stamp: "Formatted at 2026-06-15 08:05:50 on dist-test-slave-37n8"
I20260615 08:05:50.333653 8471 heartbeater.cc:344] Connected to a master server at 127.4.42.254:38799
I20260615 08:05:50.333719 8471 heartbeater.cc:461] Registering TS with master...
I20260615 08:05:50.333818 8471 heartbeater.cc:507] Master 127.4.42.254:38799 requested a full tablet report, sending...
I20260615 08:05:50.334021 8266 ts_manager.cc:194] Registered new tserver with Master: 5d3811e4fe7944c18a78fdf4516d3ce9 (127.4.42.194:39033)
I20260615 08:05:50.334209 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:05:50.334455 8266 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40372
I20260615 08:05:50.334707 8482 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:50.334836 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:50.334893 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1781510637089012-4267-0/minicluster-data/ts-2-root
uuid: "be5f9c370e4448cebe281023e15d793a"
format_stamp: "Formatted at 2026-06-15 08:05:50 on dist-test-slave-37n8"
I20260615 08:05:50.334944 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1781510637089012-4267-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1781510637089012-4267-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1781510637089012-4267-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:05:50.342453 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:05:50.342715 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:05:50.342847 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:05:50.343029 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:05:50.343073 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:50.343113 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:05:50.343146 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:50.346158 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.195:40933
I20260615 08:05:50.346235 8545 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.195:40933 every 8 connection(s)
I20260615 08:05:50.349153 8546 heartbeater.cc:344] Connected to a master server at 127.4.42.254:38799
I20260615 08:05:50.349205 8546 heartbeater.cc:461] Registering TS with master...
I20260615 08:05:50.349311 8546 heartbeater.cc:507] Master 127.4.42.254:38799 requested a full tablet report, sending...
I20260615 08:05:50.349543 8266 ts_manager.cc:194] Registered new tserver with Master: be5f9c370e4448cebe281023e15d793a (127.4.42.195:40933)
I20260615 08:05:50.349690 4267 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003337909s
I20260615 08:05:50.350042 8266 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40378
I20260615 08:05:50.354899 8266 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40384:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260615 08:05:50.355016 8266 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260615 08:05:50.359333 8435 tablet_service.cc:1511] Processing CreateTablet for tablet 660b87e2bab0436db3610ef131446519 (DEFAULT_TABLE table=test-workload [id=bf3086c49b4f4a929dff7fd3d213f1da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:05:50.359458 8435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 660b87e2bab0436db3610ef131446519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:05:50.359987 8510 tablet_service.cc:1511] Processing CreateTablet for tablet 660b87e2bab0436db3610ef131446519 (DEFAULT_TABLE table=test-workload [id=bf3086c49b4f4a929dff7fd3d213f1da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:05:50.360100 8510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 660b87e2bab0436db3610ef131446519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:05:50.360147 8359 tablet_service.cc:1511] Processing CreateTablet for tablet 660b87e2bab0436db3610ef131446519 (DEFAULT_TABLE table=test-workload [id=bf3086c49b4f4a929dff7fd3d213f1da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:05:50.360258 8359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 660b87e2bab0436db3610ef131446519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:05:50.361172 8561 tablet_bootstrap.cc:492] T 660b87e2bab0436db3610ef131446519 P 5d3811e4fe7944c18a78fdf4516d3ce9: Bootstrap starting.
I20260615 08:05:50.361375 8562 tablet_bootstrap.cc:492] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a: Bootstrap starting.
I20260615 08:05:50.361644 8563 tablet_bootstrap.cc:492] T 660b87e2bab0436db3610ef131446519 P 50b55202462e4d38b17b1061ceedaf4f: Bootstrap starting.
I20260615 08:05:50.361744 8561 tablet_bootstrap.cc:654] T 660b87e2bab0436db3610ef131446519 P 5d3811e4fe7944c18a78fdf4516d3ce9: Neither blocks nor log segments found. Creating new log.
I20260615 08:05:50.361896 8562 tablet_bootstrap.cc:654] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a: Neither blocks nor log segments found. Creating new log.
I20260615 08:05:50.362179 8563 tablet_bootstrap.cc:654] T 660b87e2bab0436db3610ef131446519 P 50b55202462e4d38b17b1061ceedaf4f: Neither blocks nor log segments found. Creating new log.
I20260615 08:05:50.362500 8561 tablet_bootstrap.cc:492] T 660b87e2bab0436db3610ef131446519 P 5d3811e4fe7944c18a78fdf4516d3ce9: No bootstrap required, opened a new log
I20260615 08:05:50.362556 8561 ts_tablet_manager.cc:1403] T 660b87e2bab0436db3610ef131446519 P 5d3811e4fe7944c18a78fdf4516d3ce9: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:05:50.362635 8562 tablet_bootstrap.cc:492] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a: No bootstrap required, opened a new log
I20260615 08:05:50.362679 8562 ts_tablet_manager.cc:1403] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:05:50.362722 8561 raft_consensus.cc:359] T 660b87e2bab0436db3610ef131446519 P 5d3811e4fe7944c18a78fdf4516d3ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d3811e4fe7944c18a78fdf4516d3ce9" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39033 } } peers { permanent_uuid: "be5f9c370e4448cebe281023e15d793a" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40933 } } peers { permanent_uuid: "50b55202462e4d38b17b1061ceedaf4f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39925 } }
I20260615 08:05:50.362794 8561 raft_consensus.cc:385] T 660b87e2bab0436db3610ef131446519 P 5d3811e4fe7944c18a78fdf4516d3ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:05:50.362838 8561 raft_consensus.cc:740] T 660b87e2bab0436db3610ef131446519 P 5d3811e4fe7944c18a78fdf4516d3ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d3811e4fe7944c18a78fdf4516d3ce9, State: Initialized, Role: FOLLOWER
I20260615 08:05:50.362907 8561 consensus_queue.cc:260] T 660b87e2bab0436db3610ef131446519 P 5d3811e4fe7944c18a78fdf4516d3ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d3811e4fe7944c18a78fdf4516d3ce9" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39033 } } peers { permanent_uuid: "be5f9c370e4448cebe281023e15d793a" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40933 } } peers { permanent_uuid: "50b55202462e4d38b17b1061ceedaf4f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39925 } }
I20260615 08:05:50.363058 8561 ts_tablet_manager.cc:1434] T 660b87e2bab0436db3610ef131446519 P 5d3811e4fe7944c18a78fdf4516d3ce9: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260615 08:05:50.363116 8471 heartbeater.cc:499] Master 127.4.42.254:38799 was elected leader, sending a full tablet report...
I20260615 08:05:50.362803 8562 raft_consensus.cc:359] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d3811e4fe7944c18a78fdf4516d3ce9" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39033 } } peers { permanent_uuid: "be5f9c370e4448cebe281023e15d793a" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40933 } } peers { permanent_uuid: "50b55202462e4d38b17b1061ceedaf4f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39925 } }
I20260615 08:05:50.363312 8562 raft_consensus.cc:385] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:05:50.363338 8562 raft_consensus.cc:740] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5f9c370e4448cebe281023e15d793a, State: Initialized, Role: FOLLOWER
I20260615 08:05:50.363390 8562 consensus_queue.cc:260] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d3811e4fe7944c18a78fdf4516d3ce9" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39033 } } peers { permanent_uuid: "be5f9c370e4448cebe281023e15d793a" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40933 } } peers { permanent_uuid: "50b55202462e4d38b17b1061ceedaf4f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39925 } }
I20260615 08:05:50.363541 8562 ts_tablet_manager.cc:1434] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:05:50.363590 8563 tablet_bootstrap.cc:492] T 660b87e2bab0436db3610ef131446519 P 50b55202462e4d38b17b1061ceedaf4f: No bootstrap required, opened a new log
I20260615 08:05:50.363602 8546 heartbeater.cc:499] Master 127.4.42.254:38799 was elected leader, sending a full tablet report...
I20260615 08:05:50.363651 8563 ts_tablet_manager.cc:1403] T 660b87e2bab0436db3610ef131446519 P 50b55202462e4d38b17b1061ceedaf4f: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260615 08:05:50.364033 8563 raft_consensus.cc:359] T 660b87e2bab0436db3610ef131446519 P 50b55202462e4d38b17b1061ceedaf4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d3811e4fe7944c18a78fdf4516d3ce9" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39033 } } peers { permanent_uuid: "be5f9c370e4448cebe281023e15d793a" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40933 } } peers { permanent_uuid: "50b55202462e4d38b17b1061ceedaf4f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39925 } }
I20260615 08:05:50.364137 8563 raft_consensus.cc:385] T 660b87e2bab0436db3610ef131446519 P 50b55202462e4d38b17b1061ceedaf4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:05:50.364181 8563 raft_consensus.cc:740] T 660b87e2bab0436db3610ef131446519 P 50b55202462e4d38b17b1061ceedaf4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50b55202462e4d38b17b1061ceedaf4f, State: Initialized, Role: FOLLOWER
I20260615 08:05:50.364256 8563 consensus_queue.cc:260] T 660b87e2bab0436db3610ef131446519 P 50b55202462e4d38b17b1061ceedaf4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d3811e4fe7944c18a78fdf4516d3ce9" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39033 } } peers { permanent_uuid: "be5f9c370e4448cebe281023e15d793a" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40933 } } peers { permanent_uuid: "50b55202462e4d38b17b1061ceedaf4f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39925 } }
I20260615 08:05:50.364420 8563 ts_tablet_manager.cc:1434] T 660b87e2bab0436db3610ef131446519 P 50b55202462e4d38b17b1061ceedaf4f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260615 08:05:50.364452 8395 heartbeater.cc:499] Master 127.4.42.254:38799 was elected leader, sending a full tablet report...
I20260615 08:05:50.622032 8568 raft_consensus.cc:493] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260615 08:05:50.622124 8568 raft_consensus.cc:515] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d3811e4fe7944c18a78fdf4516d3ce9" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39033 } } peers { permanent_uuid: "be5f9c370e4448cebe281023e15d793a" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40933 } } peers { permanent_uuid: "50b55202462e4d38b17b1061ceedaf4f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39925 } }
I20260615 08:05:50.622313 8568 leader_election.cc:290] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d3811e4fe7944c18a78fdf4516d3ce9 (127.4.42.194:39033), 50b55202462e4d38b17b1061ceedaf4f (127.4.42.193:39925)
I20260615 08:05:50.625813 8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b87e2bab0436db3610ef131446519" candidate_uuid: "be5f9c370e4448cebe281023e15d793a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b55202462e4d38b17b1061ceedaf4f" is_pre_election: true
I20260615 08:05:50.625813 8445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b87e2bab0436db3610ef131446519" candidate_uuid: "be5f9c370e4448cebe281023e15d793a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d3811e4fe7944c18a78fdf4516d3ce9" is_pre_election: true
I20260615 08:05:50.625943 8369 raft_consensus.cc:2468] T 660b87e2bab0436db3610ef131446519 P 50b55202462e4d38b17b1061ceedaf4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5f9c370e4448cebe281023e15d793a in term 0.
I20260615 08:05:50.625952 8445 raft_consensus.cc:2468] T 660b87e2bab0436db3610ef131446519 P 5d3811e4fe7944c18a78fdf4516d3ce9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be5f9c370e4448cebe281023e15d793a in term 0.
I20260615 08:05:50.626130 8483 leader_election.cc:304] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d3811e4fe7944c18a78fdf4516d3ce9, be5f9c370e4448cebe281023e15d793a; no voters:
I20260615 08:05:50.626219 8568 raft_consensus.cc:2804] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260615 08:05:50.626268 8568 raft_consensus.cc:493] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:05:50.626287 8568 raft_consensus.cc:3060] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:05:50.626919 8568 raft_consensus.cc:515] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d3811e4fe7944c18a78fdf4516d3ce9" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39033 } } peers { permanent_uuid: "be5f9c370e4448cebe281023e15d793a" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40933 } } peers { permanent_uuid: "50b55202462e4d38b17b1061ceedaf4f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39925 } }
I20260615 08:05:50.627044 8568 leader_election.cc:290] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a [CANDIDATE]: Term 1 election: Requested vote from peers 5d3811e4fe7944c18a78fdf4516d3ce9 (127.4.42.194:39033), 50b55202462e4d38b17b1061ceedaf4f (127.4.42.193:39925)
I20260615 08:05:50.627200 8445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b87e2bab0436db3610ef131446519" candidate_uuid: "be5f9c370e4448cebe281023e15d793a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d3811e4fe7944c18a78fdf4516d3ce9"
I20260615 08:05:50.627264 8445 raft_consensus.cc:3060] T 660b87e2bab0436db3610ef131446519 P 5d3811e4fe7944c18a78fdf4516d3ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:05:50.627226 8369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b87e2bab0436db3610ef131446519" candidate_uuid: "be5f9c370e4448cebe281023e15d793a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50b55202462e4d38b17b1061ceedaf4f"
I20260615 08:05:50.627334 8369 raft_consensus.cc:3060] T 660b87e2bab0436db3610ef131446519 P 50b55202462e4d38b17b1061ceedaf4f [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:05:50.627948 8445 raft_consensus.cc:2468] T 660b87e2bab0436db3610ef131446519 P 5d3811e4fe7944c18a78fdf4516d3ce9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5f9c370e4448cebe281023e15d793a in term 1.
I20260615 08:05:50.627966 8369 raft_consensus.cc:2468] T 660b87e2bab0436db3610ef131446519 P 50b55202462e4d38b17b1061ceedaf4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5f9c370e4448cebe281023e15d793a in term 1.
I20260615 08:05:50.628103 8483 leader_election.cc:304] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50b55202462e4d38b17b1061ceedaf4f, be5f9c370e4448cebe281023e15d793a; no voters:
I20260615 08:05:50.628227 8568 raft_consensus.cc:2804] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:05:50.628381 8568 raft_consensus.cc:697] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a [term 1 LEADER]: Becoming Leader. State: Replica: be5f9c370e4448cebe281023e15d793a, State: Running, Role: LEADER
I20260615 08:05:50.628441 8568 consensus_queue.cc:237] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d3811e4fe7944c18a78fdf4516d3ce9" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39033 } } peers { permanent_uuid: "be5f9c370e4448cebe281023e15d793a" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40933 } } peers { permanent_uuid: "50b55202462e4d38b17b1061ceedaf4f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39925 } }
I20260615 08:05:50.629035 8265 catalog_manager.cc:5696] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a reported cstate change: term changed from 0 to 1, leader changed from <none> to be5f9c370e4448cebe281023e15d793a (127.4.42.195). New cstate: current_term: 1 leader_uuid: "be5f9c370e4448cebe281023e15d793a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d3811e4fe7944c18a78fdf4516d3ce9" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5f9c370e4448cebe281023e15d793a" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40933 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50b55202462e4d38b17b1061ceedaf4f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39925 } health_report { overall_health: UNKNOWN } } }
I20260615 08:05:50.652753 8369 raft_consensus.cc:1275] T 660b87e2bab0436db3610ef131446519 P 50b55202462e4d38b17b1061ceedaf4f [term 1 FOLLOWER]: Refusing update from remote peer be5f9c370e4448cebe281023e15d793a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:05:50.652791 8445 raft_consensus.cc:1275] T 660b87e2bab0436db3610ef131446519 P 5d3811e4fe7944c18a78fdf4516d3ce9 [term 1 FOLLOWER]: Refusing update from remote peer be5f9c370e4448cebe281023e15d793a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:05:50.652992 8571 consensus_queue.cc:1048] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d3811e4fe7944c18a78fdf4516d3ce9" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:05:50.653103 8568 consensus_queue.cc:1048] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a [LEADER]: Connected to new peer: Peer: permanent_uuid: "50b55202462e4d38b17b1061ceedaf4f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:06:01.199537 8609 raft_consensus.cc:993] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a: : Instructing follower 50b55202462e4d38b17b1061ceedaf4f to start an election
I20260615 08:06:01.199628 8609 raft_consensus.cc:1081] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a [term 1 LEADER]: Signalling peer 50b55202462e4d38b17b1061ceedaf4f to start an election
I20260615 08:06:01.199817 8368 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "660b87e2bab0436db3610ef131446519"
dest_uuid: "50b55202462e4d38b17b1061ceedaf4f"
from {username='slave'} at 127.0.0.1:41790
I20260615 08:06:01.199931 8368 raft_consensus.cc:493] T 660b87e2bab0436db3610ef131446519 P 50b55202462e4d38b17b1061ceedaf4f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260615 08:06:01.199958 8368 raft_consensus.cc:3060] T 660b87e2bab0436db3610ef131446519 P 50b55202462e4d38b17b1061ceedaf4f [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:06:01.200598 8368 raft_consensus.cc:515] T 660b87e2bab0436db3610ef131446519 P 50b55202462e4d38b17b1061ceedaf4f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d3811e4fe7944c18a78fdf4516d3ce9" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39033 } } peers { permanent_uuid: "be5f9c370e4448cebe281023e15d793a" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40933 } } peers { permanent_uuid: "50b55202462e4d38b17b1061ceedaf4f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39925 } }
I20260615 08:06:01.200781 8368 leader_election.cc:290] T 660b87e2bab0436db3610ef131446519 P 50b55202462e4d38b17b1061ceedaf4f [CANDIDATE]: Term 2 election: Requested vote from peers 5d3811e4fe7944c18a78fdf4516d3ce9 (127.4.42.194:39033), be5f9c370e4448cebe281023e15d793a (127.4.42.195:40933)
I20260615 08:06:01.204386 8445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b87e2bab0436db3610ef131446519" candidate_uuid: "50b55202462e4d38b17b1061ceedaf4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 13669 } } ignore_live_leader: true dest_uuid: "5d3811e4fe7944c18a78fdf4516d3ce9"
I20260615 08:06:01.204463 8445 raft_consensus.cc:3060] T 660b87e2bab0436db3610ef131446519 P 5d3811e4fe7944c18a78fdf4516d3ce9 [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:06:01.205137 8445 raft_consensus.cc:2468] T 660b87e2bab0436db3610ef131446519 P 5d3811e4fe7944c18a78fdf4516d3ce9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50b55202462e4d38b17b1061ceedaf4f in term 2.
I20260615 08:06:01.205278 8520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "660b87e2bab0436db3610ef131446519" candidate_uuid: "50b55202462e4d38b17b1061ceedaf4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 13669 } } ignore_live_leader: true dest_uuid: "be5f9c370e4448cebe281023e15d793a"
I20260615 08:06:01.205350 8520 raft_consensus.cc:3055] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a [term 1 LEADER]: Stepping down as leader of term 1
I20260615 08:06:01.205377 8332 leader_election.cc:304] T 660b87e2bab0436db3610ef131446519 P 50b55202462e4d38b17b1061ceedaf4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50b55202462e4d38b17b1061ceedaf4f, 5d3811e4fe7944c18a78fdf4516d3ce9; no voters:
I20260615 08:06:01.205400 8520 raft_consensus.cc:740] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be5f9c370e4448cebe281023e15d793a, State: Running, Role: LEADER
I20260615 08:06:01.205518 8520 consensus_queue.cc:260] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13669, Committed index: 13669, Last appended: 1.13669, Last appended by leader: 13669, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d3811e4fe7944c18a78fdf4516d3ce9" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39033 } } peers { permanent_uuid: "be5f9c370e4448cebe281023e15d793a" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40933 } } peers { permanent_uuid: "50b55202462e4d38b17b1061ceedaf4f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39925 } }
I20260615 08:06:01.205610 8520 raft_consensus.cc:3060] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:06:01.205607 8614 raft_consensus.cc:2804] T 660b87e2bab0436db3610ef131446519 P 50b55202462e4d38b17b1061ceedaf4f [term 2 FOLLOWER]: Leader election won for term 2
I20260615 08:06:01.205770 8614 raft_consensus.cc:697] T 660b87e2bab0436db3610ef131446519 P 50b55202462e4d38b17b1061ceedaf4f [term 2 LEADER]: Becoming Leader. State: Replica: 50b55202462e4d38b17b1061ceedaf4f, State: Running, Role: LEADER
I20260615 08:06:01.205945 8614 consensus_queue.cc:237] T 660b87e2bab0436db3610ef131446519 P 50b55202462e4d38b17b1061ceedaf4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13669, Committed index: 13669, Last appended: 1.13669, Last appended by leader: 13669, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d3811e4fe7944c18a78fdf4516d3ce9" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39033 } } peers { permanent_uuid: "be5f9c370e4448cebe281023e15d793a" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40933 } } peers { permanent_uuid: "50b55202462e4d38b17b1061ceedaf4f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39925 } }
I20260615 08:06:01.206372 8520 raft_consensus.cc:2468] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50b55202462e4d38b17b1061ceedaf4f in term 2.
I20260615 08:06:01.206473 8258 catalog_manager.cc:5696] T 660b87e2bab0436db3610ef131446519 P 50b55202462e4d38b17b1061ceedaf4f reported cstate change: term changed from 1 to 2, leader changed from be5f9c370e4448cebe281023e15d793a (127.4.42.195) to 50b55202462e4d38b17b1061ceedaf4f (127.4.42.193). New cstate: current_term: 2 leader_uuid: "50b55202462e4d38b17b1061ceedaf4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5d3811e4fe7944c18a78fdf4516d3ce9" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5f9c370e4448cebe281023e15d793a" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50b55202462e4d38b17b1061ceedaf4f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39925 } health_report { overall_health: HEALTHY } } }
I20260615 08:06:01.213164 4267 tablet_replica.cc:333] T 660b87e2bab0436db3610ef131446519 P 50b55202462e4d38b17b1061ceedaf4f: stopping tablet replica
I20260615 08:06:01.213222 4267 raft_consensus.cc:2243] T 660b87e2bab0436db3610ef131446519 P 50b55202462e4d38b17b1061ceedaf4f [term 2 LEADER]: Raft consensus shutting down.
I20260615 08:06:01.213270 4267 pending_rounds.cc:70] T 660b87e2bab0436db3610ef131446519 P 50b55202462e4d38b17b1061ceedaf4f: Trying to abort 1 pending ops.
I20260615 08:06:01.213289 4267 pending_rounds.cc:77] T 660b87e2bab0436db3610ef131446519 P 50b55202462e4d38b17b1061ceedaf4f: Aborting op as it isn't in flight: id { term: 2 index: 13670 } timestamp: 7297068077900140544 op_type: NO_OP noop_request { }
I20260615 08:06:01.213320 4267 raft_consensus.cc:2889] T 660b87e2bab0436db3610ef131446519 P 50b55202462e4d38b17b1061ceedaf4f [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260615 08:06:01.213335 4267 raft_consensus.cc:2272] T 660b87e2bab0436db3610ef131446519 P 50b55202462e4d38b17b1061ceedaf4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:06:01.215368 4267 ts_tablet_manager.cc:1916] T 660b87e2bab0436db3610ef131446519 P 50b55202462e4d38b17b1061ceedaf4f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260615 08:06:01.216552 4267 ts_tablet_manager.cc:1929] T 660b87e2bab0436db3610ef131446519 P 50b55202462e4d38b17b1061ceedaf4f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.13670
I20260615 08:06:01.216634 4267 log.cc:1199] T 660b87e2bab0436db3610ef131446519 P 50b55202462e4d38b17b1061ceedaf4f: Deleting WAL directory at /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotRunning.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/660b87e2bab0436db3610ef131446519
I20260615 08:06:01.224809 4267 tablet_server.cc:179] TabletServer@127.4.42.193:0 shutting down...
I20260615 08:06:01.227377 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:06:01.239017 4267 tablet_server.cc:196] TabletServer@127.4.42.193:0 shutdown complete.
I20260615 08:06:01.239993 4267 tablet_server.cc:179] TabletServer@127.4.42.194:0 shutting down...
I20260615 08:06:01.242836 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:06:01.242933 4267 tablet_replica.cc:333] T 660b87e2bab0436db3610ef131446519 P 5d3811e4fe7944c18a78fdf4516d3ce9: stopping tablet replica
I20260615 08:06:01.242990 4267 raft_consensus.cc:2243] T 660b87e2bab0436db3610ef131446519 P 5d3811e4fe7944c18a78fdf4516d3ce9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260615 08:06:01.243062 4267 raft_consensus.cc:2272] T 660b87e2bab0436db3610ef131446519 P 5d3811e4fe7944c18a78fdf4516d3ce9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:06:01.264276 4267 tablet_server.cc:196] TabletServer@127.4.42.194:0 shutdown complete.
I20260615 08:06:01.265044 4267 tablet_server.cc:179] TabletServer@127.4.42.195:0 shutting down...
I20260615 08:06:01.268118 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:06:01.268253 4267 tablet_replica.cc:333] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a: stopping tablet replica
I20260615 08:06:01.268306 4267 raft_consensus.cc:2243] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260615 08:06:01.268354 4267 raft_consensus.cc:2272] T 660b87e2bab0436db3610ef131446519 P be5f9c370e4448cebe281023e15d793a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:06:01.281769 4267 tablet_server.cc:196] TabletServer@127.4.42.195:0 shutdown complete.
I20260615 08:06:01.282446 4267 master.cc:562] Master@127.4.42.254:38799 shutting down...
I20260615 08:06:01.284919 4267 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 645865a9208a41e1bcb1ec3bb8ae8014 [term 1 LEADER]: Raft consensus shutting down.
I20260615 08:06:01.284988 4267 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 645865a9208a41e1bcb1ec3bb8ae8014 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:06:01.285024 4267 tablet_replica.cc:333] T 00000000000000000000000000000000 P 645865a9208a41e1bcb1ec3bb8ae8014: stopping tablet replica
I20260615 08:06:01.286573 4267 master.cc:584] Master@127.4.42.254:38799 shutdown complete.
[ OK ] TxnParticipantITest.TestProxyTabletNotRunning (11091 ms)
[ RUN ] TxnParticipantITest.TestProxyTabletNotFound
I20260615 08:06:01.300221 4267 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.42.254:39251
I20260615 08:06:01.300410 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:06:01.301805 8625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:01.301837 8622 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:01.301863 8623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:01.301963 4267 server_base.cc:1061] running on GCE node
I20260615 08:06:01.302110 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:06:01.302150 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:06:01.302163 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510761302164 us; error 0 us; skew 500 ppm
I20260615 08:06:01.302714 4267 webserver.cc:533] Webserver started at http://127.4.42.254:34481/ using document root <none> and password file <none>
I20260615 08:06:01.302785 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:06:01.302819 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:06:01.302850 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:06:01.303071 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1781510637089012-4267-0/minicluster-data/master-0-root/instance:
uuid: "1b4c3fdfeb7c48cfbc595217fb85fd3d"
format_stamp: "Formatted at 2026-06-15 08:06:01 on dist-test-slave-37n8"
I20260615 08:06:01.303908 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:06:01.304358 8630 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:01.304507 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:01.304565 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1781510637089012-4267-0/minicluster-data/master-0-root
uuid: "1b4c3fdfeb7c48cfbc595217fb85fd3d"
format_stamp: "Formatted at 2026-06-15 08:06:01 on dist-test-slave-37n8"
I20260615 08:06:01.304611 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1781510637089012-4267-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1781510637089012-4267-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1781510637089012-4267-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:06:01.325840 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:06:01.326048 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:06:01.328667 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.254:39251
I20260615 08:06:01.330888 8682 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.254:39251 every 8 connection(s)
I20260615 08:06:01.338245 8683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:06:01.339251 8683 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b4c3fdfeb7c48cfbc595217fb85fd3d: Bootstrap starting.
I20260615 08:06:01.339474 8683 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1b4c3fdfeb7c48cfbc595217fb85fd3d: Neither blocks nor log segments found. Creating new log.
I20260615 08:06:01.339892 8683 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b4c3fdfeb7c48cfbc595217fb85fd3d: No bootstrap required, opened a new log
I20260615 08:06:01.339985 8683 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1b4c3fdfeb7c48cfbc595217fb85fd3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b4c3fdfeb7c48cfbc595217fb85fd3d" member_type: VOTER }
I20260615 08:06:01.340024 8683 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1b4c3fdfeb7c48cfbc595217fb85fd3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:06:01.340037 8683 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1b4c3fdfeb7c48cfbc595217fb85fd3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b4c3fdfeb7c48cfbc595217fb85fd3d, State: Initialized, Role: FOLLOWER
I20260615 08:06:01.340097 8683 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b4c3fdfeb7c48cfbc595217fb85fd3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b4c3fdfeb7c48cfbc595217fb85fd3d" member_type: VOTER }
I20260615 08:06:01.340139 8683 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1b4c3fdfeb7c48cfbc595217fb85fd3d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260615 08:06:01.340171 8683 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1b4c3fdfeb7c48cfbc595217fb85fd3d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260615 08:06:01.340191 8683 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1b4c3fdfeb7c48cfbc595217fb85fd3d [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:06:01.340611 8683 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1b4c3fdfeb7c48cfbc595217fb85fd3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b4c3fdfeb7c48cfbc595217fb85fd3d" member_type: VOTER }
I20260615 08:06:01.340662 8683 leader_election.cc:304] T 00000000000000000000000000000000 P 1b4c3fdfeb7c48cfbc595217fb85fd3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b4c3fdfeb7c48cfbc595217fb85fd3d; no voters:
I20260615 08:06:01.340745 8683 leader_election.cc:290] T 00000000000000000000000000000000 P 1b4c3fdfeb7c48cfbc595217fb85fd3d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260615 08:06:01.340787 8686 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1b4c3fdfeb7c48cfbc595217fb85fd3d [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:06:01.340899 8683 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1b4c3fdfeb7c48cfbc595217fb85fd3d [sys.catalog]: configured and running, proceeding with master startup.
I20260615 08:06:01.340921 8686 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1b4c3fdfeb7c48cfbc595217fb85fd3d [term 1 LEADER]: Becoming Leader. State: Replica: 1b4c3fdfeb7c48cfbc595217fb85fd3d, State: Running, Role: LEADER
I20260615 08:06:01.341025 8686 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b4c3fdfeb7c48cfbc595217fb85fd3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b4c3fdfeb7c48cfbc595217fb85fd3d" member_type: VOTER }
I20260615 08:06:01.341248 8687 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b4c3fdfeb7c48cfbc595217fb85fd3d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b4c3fdfeb7c48cfbc595217fb85fd3d. Latest consensus state: current_term: 1 leader_uuid: "1b4c3fdfeb7c48cfbc595217fb85fd3d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b4c3fdfeb7c48cfbc595217fb85fd3d" member_type: VOTER } }
I20260615 08:06:01.341246 8688 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b4c3fdfeb7c48cfbc595217fb85fd3d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1b4c3fdfeb7c48cfbc595217fb85fd3d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b4c3fdfeb7c48cfbc595217fb85fd3d" member_type: VOTER } }
I20260615 08:06:01.341368 8687 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b4c3fdfeb7c48cfbc595217fb85fd3d [sys.catalog]: This master's current role is: LEADER
I20260615 08:06:01.341387 8688 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b4c3fdfeb7c48cfbc595217fb85fd3d [sys.catalog]: This master's current role is: LEADER
I20260615 08:06:01.341552 8692 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260615 08:06:01.341701 8692 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260615 08:06:01.342281 4267 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260615 08:06:01.342304 8692 catalog_manager.cc:1382] Generated new cluster ID: 28f5e06df3574a8581cad988cb6250c6
I20260615 08:06:01.342343 8692 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260615 08:06:01.359984 8692 catalog_manager.cc:1405] Generated new certificate authority record
I20260615 08:06:01.360391 8692 catalog_manager.cc:1539] Loading token signing keys...
I20260615 08:06:01.364317 8692 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 1b4c3fdfeb7c48cfbc595217fb85fd3d: Generated new TSK 0
I20260615 08:06:01.364385 8692 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260615 08:06:01.374274 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:06:01.375607 8704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:01.375648 8707 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:01.375633 8705 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:01.375660 4267 server_base.cc:1061] running on GCE node
I20260615 08:06:01.375907 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:06:01.375937 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:06:01.375965 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510761375965 us; error 0 us; skew 500 ppm
I20260615 08:06:01.376478 4267 webserver.cc:533] Webserver started at http://127.4.42.193:38207/ using document root <none> and password file <none>
I20260615 08:06:01.376570 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:06:01.376612 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:06:01.376657 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:06:01.376932 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1781510637089012-4267-0/minicluster-data/ts-0-root/instance:
uuid: "e67e2bb4af7640c0b7b1eb93a4931aca"
format_stamp: "Formatted at 2026-06-15 08:06:01 on dist-test-slave-37n8"
I20260615 08:06:01.377797 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:06:01.378239 8712 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:01.378379 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:01.378443 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1781510637089012-4267-0/minicluster-data/ts-0-root
uuid: "e67e2bb4af7640c0b7b1eb93a4931aca"
format_stamp: "Formatted at 2026-06-15 08:06:01 on dist-test-slave-37n8"
I20260615 08:06:01.378504 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1781510637089012-4267-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1781510637089012-4267-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1781510637089012-4267-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:06:01.398458 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:06:01.398669 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:06:01.398814 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:06:01.399019 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:06:01.399065 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:01.399096 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:06:01.399122 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:01.401662 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.193:45095
I20260615 08:06:01.401723 8775 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.193:45095 every 8 connection(s)
I20260615 08:06:01.402021 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:06:01.403107 8780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:01.403117 8781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:01.403267 8783 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:01.403414 4267 server_base.cc:1061] running on GCE node
I20260615 08:06:01.403541 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:06:01.403573 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:06:01.403591 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510761403591 us; error 0 us; skew 500 ppm
I20260615 08:06:01.404196 4267 webserver.cc:533] Webserver started at http://127.4.42.194:39697/ using document root <none> and password file <none>
I20260615 08:06:01.404284 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:06:01.404327 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:06:01.404377 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:06:01.404613 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1781510637089012-4267-0/minicluster-data/ts-1-root/instance:
uuid: "57bda1443c074178a4b452b003972538"
format_stamp: "Formatted at 2026-06-15 08:06:01 on dist-test-slave-37n8"
I20260615 08:06:01.405722 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:06:01.406069 8776 heartbeater.cc:344] Connected to a master server at 127.4.42.254:39251
I20260615 08:06:01.406147 8776 heartbeater.cc:461] Registering TS with master...
I20260615 08:06:01.406245 8788 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:01.406266 8776 heartbeater.cc:507] Master 127.4.42.254:39251 requested a full tablet report, sending...
I20260615 08:06:01.406462 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:01.406530 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1781510637089012-4267-0/minicluster-data/ts-1-root
uuid: "57bda1443c074178a4b452b003972538"
format_stamp: "Formatted at 2026-06-15 08:06:01 on dist-test-slave-37n8"
I20260615 08:06:01.406543 8647 ts_manager.cc:194] Registered new tserver with Master: e67e2bb4af7640c0b7b1eb93a4931aca (127.4.42.193:45095)
I20260615 08:06:01.406585 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1781510637089012-4267-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1781510637089012-4267-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1781510637089012-4267-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:06:01.407097 8647 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49362
I20260615 08:06:01.411422 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:06:01.411587 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:06:01.411741 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:06:01.411924 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:06:01.411967 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:01.412002 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:06:01.412029 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:01.414949 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.194:39943
I20260615 08:06:01.414987 8851 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.194:39943 every 8 connection(s)
I20260615 08:06:01.415320 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:06:01.416254 8855 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:01.416277 8856 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:01.416420 8858 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:01.416687 4267 server_base.cc:1061] running on GCE node
I20260615 08:06:01.416795 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:06:01.416826 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:06:01.416843 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510761416843 us; error 0 us; skew 500 ppm
I20260615 08:06:01.417331 4267 webserver.cc:533] Webserver started at http://127.4.42.195:36725/ using document root <none> and password file <none>
I20260615 08:06:01.417464 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:06:01.417537 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:06:01.417587 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:06:01.417856 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1781510637089012-4267-0/minicluster-data/ts-2-root/instance:
uuid: "c1603ece2a0140e09d6988b2185e3396"
format_stamp: "Formatted at 2026-06-15 08:06:01 on dist-test-slave-37n8"
I20260615 08:06:01.418329 8852 heartbeater.cc:344] Connected to a master server at 127.4.42.254:39251
I20260615 08:06:01.418395 8852 heartbeater.cc:461] Registering TS with master...
I20260615 08:06:01.418520 8852 heartbeater.cc:507] Master 127.4.42.254:39251 requested a full tablet report, sending...
I20260615 08:06:01.418756 8647 ts_manager.cc:194] Registered new tserver with Master: 57bda1443c074178a4b452b003972538 (127.4.42.194:39943)
I20260615 08:06:01.419016 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:06:01.419217 8647 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49370
I20260615 08:06:01.419515 8863 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:01.419642 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:01.419691 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1781510637089012-4267-0/minicluster-data/ts-2-root
uuid: "c1603ece2a0140e09d6988b2185e3396"
format_stamp: "Formatted at 2026-06-15 08:06:01 on dist-test-slave-37n8"
I20260615 08:06:01.419731 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1781510637089012-4267-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1781510637089012-4267-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestProxyTabletNotFound.1781510637089012-4267-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:06:01.426023 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:06:01.426203 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:06:01.426316 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:06:01.426441 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:06:01.426465 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:01.426527 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:06:01.426559 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:01.429585 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.195:39169
I20260615 08:06:01.429626 8926 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.195:39169 every 8 connection(s)
I20260615 08:06:01.432325 8927 heartbeater.cc:344] Connected to a master server at 127.4.42.254:39251
I20260615 08:06:01.432407 8927 heartbeater.cc:461] Registering TS with master...
I20260615 08:06:01.432513 8927 heartbeater.cc:507] Master 127.4.42.254:39251 requested a full tablet report, sending...
I20260615 08:06:01.432761 8647 ts_manager.cc:194] Registered new tserver with Master: c1603ece2a0140e09d6988b2185e3396 (127.4.42.195:39169)
I20260615 08:06:01.433101 4267 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003317955s
I20260615 08:06:01.433128 8647 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49384
I20260615 08:06:01.437759 8647 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49396:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260615 08:06:01.437913 8647 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260615 08:06:01.442462 8816 tablet_service.cc:1511] Processing CreateTablet for tablet 3289a516b37045978ac49a123503f7a6 (DEFAULT_TABLE table=test-workload [id=1d004a31f2b843bf820a715dc4baf04d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:06:01.442603 8816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3289a516b37045978ac49a123503f7a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:06:01.443105 8740 tablet_service.cc:1511] Processing CreateTablet for tablet 3289a516b37045978ac49a123503f7a6 (DEFAULT_TABLE table=test-workload [id=1d004a31f2b843bf820a715dc4baf04d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:06:01.443200 8740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3289a516b37045978ac49a123503f7a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:06:01.444065 8942 tablet_bootstrap.cc:492] T 3289a516b37045978ac49a123503f7a6 P 57bda1443c074178a4b452b003972538: Bootstrap starting.
I20260615 08:06:01.444466 8942 tablet_bootstrap.cc:654] T 3289a516b37045978ac49a123503f7a6 P 57bda1443c074178a4b452b003972538: Neither blocks nor log segments found. Creating new log.
I20260615 08:06:01.444487 8943 tablet_bootstrap.cc:492] T 3289a516b37045978ac49a123503f7a6 P e67e2bb4af7640c0b7b1eb93a4931aca: Bootstrap starting.
I20260615 08:06:01.444667 8891 tablet_service.cc:1511] Processing CreateTablet for tablet 3289a516b37045978ac49a123503f7a6 (DEFAULT_TABLE table=test-workload [id=1d004a31f2b843bf820a715dc4baf04d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:06:01.444779 8891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3289a516b37045978ac49a123503f7a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:06:01.444934 8943 tablet_bootstrap.cc:654] T 3289a516b37045978ac49a123503f7a6 P e67e2bb4af7640c0b7b1eb93a4931aca: Neither blocks nor log segments found. Creating new log.
I20260615 08:06:01.445492 8943 tablet_bootstrap.cc:492] T 3289a516b37045978ac49a123503f7a6 P e67e2bb4af7640c0b7b1eb93a4931aca: No bootstrap required, opened a new log
I20260615 08:06:01.445536 8943 ts_tablet_manager.cc:1403] T 3289a516b37045978ac49a123503f7a6 P e67e2bb4af7640c0b7b1eb93a4931aca: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:06:01.445672 8943 raft_consensus.cc:359] T 3289a516b37045978ac49a123503f7a6 P e67e2bb4af7640c0b7b1eb93a4931aca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57bda1443c074178a4b452b003972538" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39943 } } peers { permanent_uuid: "c1603ece2a0140e09d6988b2185e3396" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39169 } } peers { permanent_uuid: "e67e2bb4af7640c0b7b1eb93a4931aca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 45095 } }
I20260615 08:06:01.445722 8943 raft_consensus.cc:385] T 3289a516b37045978ac49a123503f7a6 P e67e2bb4af7640c0b7b1eb93a4931aca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:06:01.445740 8943 raft_consensus.cc:740] T 3289a516b37045978ac49a123503f7a6 P e67e2bb4af7640c0b7b1eb93a4931aca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e67e2bb4af7640c0b7b1eb93a4931aca, State: Initialized, Role: FOLLOWER
I20260615 08:06:01.445793 8943 consensus_queue.cc:260] T 3289a516b37045978ac49a123503f7a6 P e67e2bb4af7640c0b7b1eb93a4931aca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57bda1443c074178a4b452b003972538" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39943 } } peers { permanent_uuid: "c1603ece2a0140e09d6988b2185e3396" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39169 } } peers { permanent_uuid: "e67e2bb4af7640c0b7b1eb93a4931aca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 45095 } }
I20260615 08:06:01.445956 8943 ts_tablet_manager.cc:1434] T 3289a516b37045978ac49a123503f7a6 P e67e2bb4af7640c0b7b1eb93a4931aca: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260615 08:06:01.445998 8776 heartbeater.cc:499] Master 127.4.42.254:39251 was elected leader, sending a full tablet report...
I20260615 08:06:01.446195 8947 tablet_bootstrap.cc:492] T 3289a516b37045978ac49a123503f7a6 P c1603ece2a0140e09d6988b2185e3396: Bootstrap starting.
I20260615 08:06:01.446624 8942 tablet_bootstrap.cc:492] T 3289a516b37045978ac49a123503f7a6 P 57bda1443c074178a4b452b003972538: No bootstrap required, opened a new log
I20260615 08:06:01.446673 8942 ts_tablet_manager.cc:1403] T 3289a516b37045978ac49a123503f7a6 P 57bda1443c074178a4b452b003972538: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260615 08:06:01.446811 8942 raft_consensus.cc:359] T 3289a516b37045978ac49a123503f7a6 P 57bda1443c074178a4b452b003972538 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57bda1443c074178a4b452b003972538" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39943 } } peers { permanent_uuid: "c1603ece2a0140e09d6988b2185e3396" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39169 } } peers { permanent_uuid: "e67e2bb4af7640c0b7b1eb93a4931aca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 45095 } }
I20260615 08:06:01.446870 8942 raft_consensus.cc:385] T 3289a516b37045978ac49a123503f7a6 P 57bda1443c074178a4b452b003972538 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:06:01.446878 8947 tablet_bootstrap.cc:654] T 3289a516b37045978ac49a123503f7a6 P c1603ece2a0140e09d6988b2185e3396: Neither blocks nor log segments found. Creating new log.
I20260615 08:06:01.446908 8942 raft_consensus.cc:740] T 3289a516b37045978ac49a123503f7a6 P 57bda1443c074178a4b452b003972538 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57bda1443c074178a4b452b003972538, State: Initialized, Role: FOLLOWER
I20260615 08:06:01.447096 8942 consensus_queue.cc:260] T 3289a516b37045978ac49a123503f7a6 P 57bda1443c074178a4b452b003972538 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57bda1443c074178a4b452b003972538" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39943 } } peers { permanent_uuid: "c1603ece2a0140e09d6988b2185e3396" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39169 } } peers { permanent_uuid: "e67e2bb4af7640c0b7b1eb93a4931aca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 45095 } }
I20260615 08:06:01.447371 8942 ts_tablet_manager.cc:1434] T 3289a516b37045978ac49a123503f7a6 P 57bda1443c074178a4b452b003972538: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260615 08:06:01.447408 8852 heartbeater.cc:499] Master 127.4.42.254:39251 was elected leader, sending a full tablet report...
I20260615 08:06:01.447877 8947 tablet_bootstrap.cc:492] T 3289a516b37045978ac49a123503f7a6 P c1603ece2a0140e09d6988b2185e3396: No bootstrap required, opened a new log
I20260615 08:06:01.447928 8947 ts_tablet_manager.cc:1403] T 3289a516b37045978ac49a123503f7a6 P c1603ece2a0140e09d6988b2185e3396: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260615 08:06:01.448079 8947 raft_consensus.cc:359] T 3289a516b37045978ac49a123503f7a6 P c1603ece2a0140e09d6988b2185e3396 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57bda1443c074178a4b452b003972538" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39943 } } peers { permanent_uuid: "c1603ece2a0140e09d6988b2185e3396" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39169 } } peers { permanent_uuid: "e67e2bb4af7640c0b7b1eb93a4931aca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 45095 } }
I20260615 08:06:01.448136 8947 raft_consensus.cc:385] T 3289a516b37045978ac49a123503f7a6 P c1603ece2a0140e09d6988b2185e3396 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:06:01.448175 8947 raft_consensus.cc:740] T 3289a516b37045978ac49a123503f7a6 P c1603ece2a0140e09d6988b2185e3396 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1603ece2a0140e09d6988b2185e3396, State: Initialized, Role: FOLLOWER
I20260615 08:06:01.448227 8947 consensus_queue.cc:260] T 3289a516b37045978ac49a123503f7a6 P c1603ece2a0140e09d6988b2185e3396 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57bda1443c074178a4b452b003972538" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39943 } } peers { permanent_uuid: "c1603ece2a0140e09d6988b2185e3396" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39169 } } peers { permanent_uuid: "e67e2bb4af7640c0b7b1eb93a4931aca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 45095 } }
I20260615 08:06:01.448410 8947 ts_tablet_manager.cc:1434] T 3289a516b37045978ac49a123503f7a6 P c1603ece2a0140e09d6988b2185e3396: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260615 08:06:01.448417 8927 heartbeater.cc:499] Master 127.4.42.254:39251 was elected leader, sending a full tablet report...
W20260615 08:06:01.652067 8777 tablet.cc:2404] T 3289a516b37045978ac49a123503f7a6 P e67e2bb4af7640c0b7b1eb93a4931aca: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260615 08:06:01.652515 8949 raft_consensus.cc:493] T 3289a516b37045978ac49a123503f7a6 P 57bda1443c074178a4b452b003972538 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260615 08:06:01.652590 8949 raft_consensus.cc:515] T 3289a516b37045978ac49a123503f7a6 P 57bda1443c074178a4b452b003972538 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57bda1443c074178a4b452b003972538" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39943 } } peers { permanent_uuid: "c1603ece2a0140e09d6988b2185e3396" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39169 } } peers { permanent_uuid: "e67e2bb4af7640c0b7b1eb93a4931aca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 45095 } }
I20260615 08:06:01.652806 8949 leader_election.cc:290] T 3289a516b37045978ac49a123503f7a6 P 57bda1443c074178a4b452b003972538 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1603ece2a0140e09d6988b2185e3396 (127.4.42.195:39169), e67e2bb4af7640c0b7b1eb93a4931aca (127.4.42.193:45095)
I20260615 08:06:01.655690 8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3289a516b37045978ac49a123503f7a6" candidate_uuid: "57bda1443c074178a4b452b003972538" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1603ece2a0140e09d6988b2185e3396" is_pre_election: true
I20260615 08:06:01.655812 8901 raft_consensus.cc:2468] T 3289a516b37045978ac49a123503f7a6 P c1603ece2a0140e09d6988b2185e3396 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57bda1443c074178a4b452b003972538 in term 0.
I20260615 08:06:01.655889 8750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3289a516b37045978ac49a123503f7a6" candidate_uuid: "57bda1443c074178a4b452b003972538" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e67e2bb4af7640c0b7b1eb93a4931aca" is_pre_election: true
I20260615 08:06:01.655964 8750 raft_consensus.cc:2468] T 3289a516b37045978ac49a123503f7a6 P e67e2bb4af7640c0b7b1eb93a4931aca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 57bda1443c074178a4b452b003972538 in term 0.
I20260615 08:06:01.656078 8791 leader_election.cc:304] T 3289a516b37045978ac49a123503f7a6 P 57bda1443c074178a4b452b003972538 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57bda1443c074178a4b452b003972538, c1603ece2a0140e09d6988b2185e3396; no voters:
I20260615 08:06:01.656155 8949 raft_consensus.cc:2804] T 3289a516b37045978ac49a123503f7a6 P 57bda1443c074178a4b452b003972538 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260615 08:06:01.656188 8949 raft_consensus.cc:493] T 3289a516b37045978ac49a123503f7a6 P 57bda1443c074178a4b452b003972538 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:06:01.656213 8949 raft_consensus.cc:3060] T 3289a516b37045978ac49a123503f7a6 P 57bda1443c074178a4b452b003972538 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:06:01.656855 8949 raft_consensus.cc:515] T 3289a516b37045978ac49a123503f7a6 P 57bda1443c074178a4b452b003972538 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57bda1443c074178a4b452b003972538" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39943 } } peers { permanent_uuid: "c1603ece2a0140e09d6988b2185e3396" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39169 } } peers { permanent_uuid: "e67e2bb4af7640c0b7b1eb93a4931aca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 45095 } }
I20260615 08:06:01.656992 8949 leader_election.cc:290] T 3289a516b37045978ac49a123503f7a6 P 57bda1443c074178a4b452b003972538 [CANDIDATE]: Term 1 election: Requested vote from peers c1603ece2a0140e09d6988b2185e3396 (127.4.42.195:39169), e67e2bb4af7640c0b7b1eb93a4931aca (127.4.42.193:45095)
I20260615 08:06:01.657111 8901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3289a516b37045978ac49a123503f7a6" candidate_uuid: "57bda1443c074178a4b452b003972538" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1603ece2a0140e09d6988b2185e3396"
I20260615 08:06:01.657171 8901 raft_consensus.cc:3060] T 3289a516b37045978ac49a123503f7a6 P c1603ece2a0140e09d6988b2185e3396 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:06:01.657131 8750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3289a516b37045978ac49a123503f7a6" candidate_uuid: "57bda1443c074178a4b452b003972538" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e67e2bb4af7640c0b7b1eb93a4931aca"
I20260615 08:06:01.657225 8750 raft_consensus.cc:3060] T 3289a516b37045978ac49a123503f7a6 P e67e2bb4af7640c0b7b1eb93a4931aca [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:06:01.657845 8901 raft_consensus.cc:2468] T 3289a516b37045978ac49a123503f7a6 P c1603ece2a0140e09d6988b2185e3396 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57bda1443c074178a4b452b003972538 in term 1.
I20260615 08:06:01.657961 8750 raft_consensus.cc:2468] T 3289a516b37045978ac49a123503f7a6 P e67e2bb4af7640c0b7b1eb93a4931aca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 57bda1443c074178a4b452b003972538 in term 1.
I20260615 08:06:01.658022 8791 leader_election.cc:304] T 3289a516b37045978ac49a123503f7a6 P 57bda1443c074178a4b452b003972538 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 57bda1443c074178a4b452b003972538, c1603ece2a0140e09d6988b2185e3396; no voters:
I20260615 08:06:01.658120 8949 raft_consensus.cc:2804] T 3289a516b37045978ac49a123503f7a6 P 57bda1443c074178a4b452b003972538 [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:06:01.658267 8949 raft_consensus.cc:697] T 3289a516b37045978ac49a123503f7a6 P 57bda1443c074178a4b452b003972538 [term 1 LEADER]: Becoming Leader. State: Replica: 57bda1443c074178a4b452b003972538, State: Running, Role: LEADER
I20260615 08:06:01.658319 8949 consensus_queue.cc:237] T 3289a516b37045978ac49a123503f7a6 P 57bda1443c074178a4b452b003972538 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57bda1443c074178a4b452b003972538" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39943 } } peers { permanent_uuid: "c1603ece2a0140e09d6988b2185e3396" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39169 } } peers { permanent_uuid: "e67e2bb4af7640c0b7b1eb93a4931aca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 45095 } }
I20260615 08:06:01.658982 8646 catalog_manager.cc:5696] T 3289a516b37045978ac49a123503f7a6 P 57bda1443c074178a4b452b003972538 reported cstate change: term changed from 0 to 1, leader changed from <none> to 57bda1443c074178a4b452b003972538 (127.4.42.194). New cstate: current_term: 1 leader_uuid: "57bda1443c074178a4b452b003972538" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "57bda1443c074178a4b452b003972538" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39943 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1603ece2a0140e09d6988b2185e3396" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e67e2bb4af7640c0b7b1eb93a4931aca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 45095 } health_report { overall_health: UNKNOWN } } }
I20260615 08:06:01.676693 8750 raft_consensus.cc:1275] T 3289a516b37045978ac49a123503f7a6 P e67e2bb4af7640c0b7b1eb93a4931aca [term 1 FOLLOWER]: Refusing update from remote peer 57bda1443c074178a4b452b003972538: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:06:01.676693 8901 raft_consensus.cc:1275] T 3289a516b37045978ac49a123503f7a6 P c1603ece2a0140e09d6988b2185e3396 [term 1 FOLLOWER]: Refusing update from remote peer 57bda1443c074178a4b452b003972538: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:06:01.676928 8949 consensus_queue.cc:1048] T 3289a516b37045978ac49a123503f7a6 P 57bda1443c074178a4b452b003972538 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e67e2bb4af7640c0b7b1eb93a4931aca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 45095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:06:01.677026 8952 consensus_queue.cc:1048] T 3289a516b37045978ac49a123503f7a6 P 57bda1443c074178a4b452b003972538 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1603ece2a0140e09d6988b2185e3396" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:06:01.681272 8959 mvcc.cc:204] Tried to move back new op lower bound from 7297068079828054016 to 7297068079753224192. Current Snapshot: MvccSnapshot[applied={T|T < 7297068079827210240 or (T in {7297068079827623936})}]
I20260615 08:06:11.675437 4267 tablet_server.cc:179] TabletServer@127.4.42.193:0 shutting down...
I20260615 08:06:11.677981 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:06:11.678085 4267 tablet_replica.cc:333] T 3289a516b37045978ac49a123503f7a6 P e67e2bb4af7640c0b7b1eb93a4931aca: stopping tablet replica
I20260615 08:06:11.678146 4267 raft_consensus.cc:2243] T 3289a516b37045978ac49a123503f7a6 P e67e2bb4af7640c0b7b1eb93a4931aca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260615 08:06:11.678201 4267 raft_consensus.cc:2272] T 3289a516b37045978ac49a123503f7a6 P e67e2bb4af7640c0b7b1eb93a4931aca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:06:11.692968 4267 tablet_server.cc:196] TabletServer@127.4.42.193:0 shutdown complete.
I20260615 08:06:11.693756 4267 tablet_server.cc:179] TabletServer@127.4.42.194:0 shutting down...
I20260615 08:06:11.697567 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:06:11.697661 4267 tablet_replica.cc:333] T 3289a516b37045978ac49a123503f7a6 P 57bda1443c074178a4b452b003972538: stopping tablet replica
I20260615 08:06:11.697721 4267 raft_consensus.cc:2243] T 3289a516b37045978ac49a123503f7a6 P 57bda1443c074178a4b452b003972538 [term 1 LEADER]: Raft consensus shutting down.
I20260615 08:06:11.697782 4267 raft_consensus.cc:2272] T 3289a516b37045978ac49a123503f7a6 P 57bda1443c074178a4b452b003972538 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:06:11.701648 4267 tablet_server.cc:196] TabletServer@127.4.42.194:0 shutdown complete.
I20260615 08:06:11.702363 4267 tablet_server.cc:179] TabletServer@127.4.42.195:0 shutting down...
I20260615 08:06:11.705256 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:06:11.705374 4267 tablet_replica.cc:333] T 3289a516b37045978ac49a123503f7a6 P c1603ece2a0140e09d6988b2185e3396: stopping tablet replica
I20260615 08:06:11.705430 4267 raft_consensus.cc:2243] T 3289a516b37045978ac49a123503f7a6 P c1603ece2a0140e09d6988b2185e3396 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260615 08:06:11.705489 4267 raft_consensus.cc:2272] T 3289a516b37045978ac49a123503f7a6 P c1603ece2a0140e09d6988b2185e3396 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:06:11.719520 4267 tablet_server.cc:196] TabletServer@127.4.42.195:0 shutdown complete.
I20260615 08:06:11.720292 4267 master.cc:562] Master@127.4.42.254:39251 shutting down...
I20260615 08:06:11.722966 4267 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1b4c3fdfeb7c48cfbc595217fb85fd3d [term 1 LEADER]: Raft consensus shutting down.
I20260615 08:06:11.723019 4267 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1b4c3fdfeb7c48cfbc595217fb85fd3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:06:11.723080 4267 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1b4c3fdfeb7c48cfbc595217fb85fd3d: stopping tablet replica
I20260615 08:06:11.734552 4267 master.cc:584] Master@127.4.42.254:39251 shutdown complete.
[ OK ] TxnParticipantITest.TestProxyTabletNotFound (10453 ms)
[ RUN ] TxnParticipantITest.TestTxnSystemClientGetMetadata
I20260615 08:06:11.753412 4267 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.42.254:34025
I20260615 08:06:11.753548 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:06:11.754645 9002 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:11.754691 9003 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:11.754789 9005 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:11.754802 4267 server_base.cc:1061] running on GCE node
I20260615 08:06:11.754978 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:06:11.755012 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:06:11.755038 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510771755038 us; error 0 us; skew 500 ppm
I20260615 08:06:11.755597 4267 webserver.cc:533] Webserver started at http://127.4.42.254:40809/ using document root <none> and password file <none>
I20260615 08:06:11.755697 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:06:11.755743 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:06:11.755787 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:06:11.756074 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1781510637089012-4267-0/minicluster-data/master-0-root/instance:
uuid: "7177ab3ac61740368f33b8c9dd125711"
format_stamp: "Formatted at 2026-06-15 08:06:11 on dist-test-slave-37n8"
I20260615 08:06:11.756908 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:06:11.757340 9010 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:11.757462 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:11.757526 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1781510637089012-4267-0/minicluster-data/master-0-root
uuid: "7177ab3ac61740368f33b8c9dd125711"
format_stamp: "Formatted at 2026-06-15 08:06:11 on dist-test-slave-37n8"
I20260615 08:06:11.757572 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1781510637089012-4267-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1781510637089012-4267-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1781510637089012-4267-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:06:11.774048 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:06:11.774233 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:06:11.776736 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.254:34025
I20260615 08:06:11.781534 9063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:06:11.783332 9063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7177ab3ac61740368f33b8c9dd125711: Bootstrap starting.
I20260615 08:06:11.784972 9062 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.254:34025 every 8 connection(s)
I20260615 08:06:11.784982 9063 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7177ab3ac61740368f33b8c9dd125711: Neither blocks nor log segments found. Creating new log.
I20260615 08:06:11.785468 9063 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7177ab3ac61740368f33b8c9dd125711: No bootstrap required, opened a new log
I20260615 08:06:11.785625 9063 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7177ab3ac61740368f33b8c9dd125711 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7177ab3ac61740368f33b8c9dd125711" member_type: VOTER }
I20260615 08:06:11.785687 9063 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7177ab3ac61740368f33b8c9dd125711 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:06:11.785712 9063 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7177ab3ac61740368f33b8c9dd125711 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7177ab3ac61740368f33b8c9dd125711, State: Initialized, Role: FOLLOWER
I20260615 08:06:11.785769 9063 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7177ab3ac61740368f33b8c9dd125711 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7177ab3ac61740368f33b8c9dd125711" member_type: VOTER }
I20260615 08:06:11.785822 9063 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7177ab3ac61740368f33b8c9dd125711 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260615 08:06:11.785848 9063 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7177ab3ac61740368f33b8c9dd125711 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260615 08:06:11.785878 9063 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7177ab3ac61740368f33b8c9dd125711 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:06:11.786340 9063 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7177ab3ac61740368f33b8c9dd125711 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7177ab3ac61740368f33b8c9dd125711" member_type: VOTER }
I20260615 08:06:11.786414 9063 leader_election.cc:304] T 00000000000000000000000000000000 P 7177ab3ac61740368f33b8c9dd125711 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7177ab3ac61740368f33b8c9dd125711; no voters:
I20260615 08:06:11.786543 9063 leader_election.cc:290] T 00000000000000000000000000000000 P 7177ab3ac61740368f33b8c9dd125711 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260615 08:06:11.786577 9066 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7177ab3ac61740368f33b8c9dd125711 [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:06:11.786698 9063 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7177ab3ac61740368f33b8c9dd125711 [sys.catalog]: configured and running, proceeding with master startup.
I20260615 08:06:11.786713 9066 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7177ab3ac61740368f33b8c9dd125711 [term 1 LEADER]: Becoming Leader. State: Replica: 7177ab3ac61740368f33b8c9dd125711, State: Running, Role: LEADER
I20260615 08:06:11.786859 9066 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7177ab3ac61740368f33b8c9dd125711 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7177ab3ac61740368f33b8c9dd125711" member_type: VOTER }
I20260615 08:06:11.787070 9067 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7177ab3ac61740368f33b8c9dd125711 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7177ab3ac61740368f33b8c9dd125711" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7177ab3ac61740368f33b8c9dd125711" member_type: VOTER } }
I20260615 08:06:11.787096 9068 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7177ab3ac61740368f33b8c9dd125711 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7177ab3ac61740368f33b8c9dd125711. Latest consensus state: current_term: 1 leader_uuid: "7177ab3ac61740368f33b8c9dd125711" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7177ab3ac61740368f33b8c9dd125711" member_type: VOTER } }
I20260615 08:06:11.787140 9067 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7177ab3ac61740368f33b8c9dd125711 [sys.catalog]: This master's current role is: LEADER
I20260615 08:06:11.787284 9068 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7177ab3ac61740368f33b8c9dd125711 [sys.catalog]: This master's current role is: LEADER
I20260615 08:06:11.787333 9071 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260615 08:06:11.787537 9071 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260615 08:06:11.788111 4267 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260615 08:06:11.788160 9071 catalog_manager.cc:1382] Generated new cluster ID: 2aed20120f3c481fae43a5c8e749145f
I20260615 08:06:11.788193 9071 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260615 08:06:11.794214 9071 catalog_manager.cc:1405] Generated new certificate authority record
I20260615 08:06:11.794721 9071 catalog_manager.cc:1539] Loading token signing keys...
I20260615 08:06:11.798367 9071 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 7177ab3ac61740368f33b8c9dd125711: Generated new TSK 0
I20260615 08:06:11.798439 9071 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260615 08:06:11.803719 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:06:11.805044 9085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:11.805094 4267 server_base.cc:1061] running on GCE node
W20260615 08:06:11.805145 9087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:11.805208 9084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:11.805353 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:06:11.805398 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:06:11.805428 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510771805427 us; error 0 us; skew 500 ppm
I20260615 08:06:11.805987 4267 webserver.cc:533] Webserver started at http://127.4.42.193:34909/ using document root <none> and password file <none>
I20260615 08:06:11.806084 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:06:11.806128 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:06:11.806185 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:06:11.806422 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1781510637089012-4267-0/minicluster-data/ts-0-root/instance:
uuid: "7c6dc0246eb54fe6bc202fa4faf884aa"
format_stamp: "Formatted at 2026-06-15 08:06:11 on dist-test-slave-37n8"
I20260615 08:06:11.807274 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:06:11.807696 9092 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:11.807821 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:11.807875 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1781510637089012-4267-0/minicluster-data/ts-0-root
uuid: "7c6dc0246eb54fe6bc202fa4faf884aa"
format_stamp: "Formatted at 2026-06-15 08:06:11 on dist-test-slave-37n8"
I20260615 08:06:11.807932 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1781510637089012-4267-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1781510637089012-4267-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1781510637089012-4267-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:06:11.819641 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:06:11.819813 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:06:11.819947 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:06:11.820117 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:06:11.820153 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:11.820195 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:06:11.820221 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:11.822928 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.193:33073
I20260615 08:06:11.823319 9155 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.193:33073 every 8 connection(s)
I20260615 08:06:11.823463 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:06:11.824483 9160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:11.824579 9163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:11.824661 9161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:11.825450 4267 server_base.cc:1061] running on GCE node
I20260615 08:06:11.825569 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:06:11.825616 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:06:11.825634 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510771825634 us; error 0 us; skew 500 ppm
I20260615 08:06:11.826293 4267 webserver.cc:533] Webserver started at http://127.4.42.194:33559/ using document root <none> and password file <none>
I20260615 08:06:11.826427 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:06:11.826481 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:06:11.826546 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:06:11.826838 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1781510637089012-4267-0/minicluster-data/ts-1-root/instance:
uuid: "1bae5c017edf4654904bc11aee7147ea"
format_stamp: "Formatted at 2026-06-15 08:06:11 on dist-test-slave-37n8"
I20260615 08:06:11.826979 9156 heartbeater.cc:344] Connected to a master server at 127.4.42.254:34025
I20260615 08:06:11.827041 9156 heartbeater.cc:461] Registering TS with master...
I20260615 08:06:11.827152 9156 heartbeater.cc:507] Master 127.4.42.254:34025 requested a full tablet report, sending...
I20260615 08:06:11.827394 9027 ts_manager.cc:194] Registered new tserver with Master: 7c6dc0246eb54fe6bc202fa4faf884aa (127.4.42.193:33073)
I20260615 08:06:11.827931 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:06:11.828258 9027 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48346
I20260615 08:06:11.828474 9168 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:11.828596 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:11.828649 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1781510637089012-4267-0/minicluster-data/ts-1-root
uuid: "1bae5c017edf4654904bc11aee7147ea"
format_stamp: "Formatted at 2026-06-15 08:06:11 on dist-test-slave-37n8"
I20260615 08:06:11.828691 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1781510637089012-4267-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1781510637089012-4267-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1781510637089012-4267-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:06:11.836796 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:06:11.836958 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:06:11.837091 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:06:11.837280 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:06:11.837306 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:11.837335 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:06:11.837363 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:11.840413 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.194:35767
I20260615 08:06:11.840438 9231 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.194:35767 every 8 connection(s)
I20260615 08:06:11.840749 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:06:11.841697 9235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:11.841760 9236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:11.841935 4267 server_base.cc:1061] running on GCE node
W20260615 08:06:11.842133 9238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:11.842340 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:06:11.842384 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:06:11.842406 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510771842406 us; error 0 us; skew 500 ppm
I20260615 08:06:11.842968 4267 webserver.cc:533] Webserver started at http://127.4.42.195:44293/ using document root <none> and password file <none>
I20260615 08:06:11.843057 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:06:11.843102 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:06:11.843148 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:06:11.843420 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1781510637089012-4267-0/minicluster-data/ts-2-root/instance:
uuid: "608b52f585d648799fc291b80dc18cd4"
format_stamp: "Formatted at 2026-06-15 08:06:11 on dist-test-slave-37n8"
I20260615 08:06:11.843611 9232 heartbeater.cc:344] Connected to a master server at 127.4.42.254:34025
I20260615 08:06:11.843677 9232 heartbeater.cc:461] Registering TS with master...
I20260615 08:06:11.843772 9232 heartbeater.cc:507] Master 127.4.42.254:34025 requested a full tablet report, sending...
I20260615 08:06:11.843987 9027 ts_manager.cc:194] Registered new tserver with Master: 1bae5c017edf4654904bc11aee7147ea (127.4.42.194:35767)
I20260615 08:06:11.844287 9027 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48356
I20260615 08:06:11.844539 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:06:11.844973 9243 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:11.845075 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:11.845124 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1781510637089012-4267-0/minicluster-data/ts-2-root
uuid: "608b52f585d648799fc291b80dc18cd4"
format_stamp: "Formatted at 2026-06-15 08:06:11 on dist-test-slave-37n8"
I20260615 08:06:11.845166 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1781510637089012-4267-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1781510637089012-4267-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientGetMetadata.1781510637089012-4267-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:06:11.853113 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:06:11.853313 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:06:11.853462 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:06:11.853636 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:06:11.853681 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:11.853718 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:06:11.853747 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:11.856904 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.195:42269
I20260615 08:06:11.856930 9306 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.195:42269 every 8 connection(s)
I20260615 08:06:11.859524 9307 heartbeater.cc:344] Connected to a master server at 127.4.42.254:34025
I20260615 08:06:11.859589 9307 heartbeater.cc:461] Registering TS with master...
I20260615 08:06:11.859694 9307 heartbeater.cc:507] Master 127.4.42.254:34025 requested a full tablet report, sending...
I20260615 08:06:11.859901 9027 ts_manager.cc:194] Registered new tserver with Master: 608b52f585d648799fc291b80dc18cd4 (127.4.42.195:42269)
I20260615 08:06:11.860251 9027 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48366
I20260615 08:06:11.860430 4267 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.0033495s
I20260615 08:06:11.864816 9027 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48382:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260615 08:06:11.864964 9027 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260615 08:06:11.869448 9196 tablet_service.cc:1511] Processing CreateTablet for tablet 0b2258aecaf246d59142df50dd5e6688 (DEFAULT_TABLE table=test-workload [id=76beb502d1c84b20bcef306817ae8c55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:06:11.869540 9120 tablet_service.cc:1511] Processing CreateTablet for tablet 0b2258aecaf246d59142df50dd5e6688 (DEFAULT_TABLE table=test-workload [id=76beb502d1c84b20bcef306817ae8c55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:06:11.869580 9196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b2258aecaf246d59142df50dd5e6688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:06:11.869616 9120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b2258aecaf246d59142df50dd5e6688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:06:11.871111 9323 tablet_bootstrap.cc:492] T 0b2258aecaf246d59142df50dd5e6688 P 7c6dc0246eb54fe6bc202fa4faf884aa: Bootstrap starting.
I20260615 08:06:11.871182 9271 tablet_service.cc:1511] Processing CreateTablet for tablet 0b2258aecaf246d59142df50dd5e6688 (DEFAULT_TABLE table=test-workload [id=76beb502d1c84b20bcef306817ae8c55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:06:11.871317 9271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b2258aecaf246d59142df50dd5e6688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:06:11.871562 9323 tablet_bootstrap.cc:654] T 0b2258aecaf246d59142df50dd5e6688 P 7c6dc0246eb54fe6bc202fa4faf884aa: Neither blocks nor log segments found. Creating new log.
I20260615 08:06:11.872008 9322 tablet_bootstrap.cc:492] T 0b2258aecaf246d59142df50dd5e6688 P 1bae5c017edf4654904bc11aee7147ea: Bootstrap starting.
I20260615 08:06:11.872404 9322 tablet_bootstrap.cc:654] T 0b2258aecaf246d59142df50dd5e6688 P 1bae5c017edf4654904bc11aee7147ea: Neither blocks nor log segments found. Creating new log.
I20260615 08:06:11.872509 9325 tablet_bootstrap.cc:492] T 0b2258aecaf246d59142df50dd5e6688 P 608b52f585d648799fc291b80dc18cd4: Bootstrap starting.
I20260615 08:06:11.872862 9323 tablet_bootstrap.cc:492] T 0b2258aecaf246d59142df50dd5e6688 P 7c6dc0246eb54fe6bc202fa4faf884aa: No bootstrap required, opened a new log
I20260615 08:06:11.872910 9325 tablet_bootstrap.cc:654] T 0b2258aecaf246d59142df50dd5e6688 P 608b52f585d648799fc291b80dc18cd4: Neither blocks nor log segments found. Creating new log.
I20260615 08:06:11.873045 9322 tablet_bootstrap.cc:492] T 0b2258aecaf246d59142df50dd5e6688 P 1bae5c017edf4654904bc11aee7147ea: No bootstrap required, opened a new log
I20260615 08:06:11.873107 9322 ts_tablet_manager.cc:1403] T 0b2258aecaf246d59142df50dd5e6688 P 1bae5c017edf4654904bc11aee7147ea: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:06:11.873416 9322 raft_consensus.cc:359] T 0b2258aecaf246d59142df50dd5e6688 P 1bae5c017edf4654904bc11aee7147ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bae5c017edf4654904bc11aee7147ea" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 35767 } } peers { permanent_uuid: "7c6dc0246eb54fe6bc202fa4faf884aa" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33073 } } peers { permanent_uuid: "608b52f585d648799fc291b80dc18cd4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42269 } }
I20260615 08:06:11.873512 9322 raft_consensus.cc:385] T 0b2258aecaf246d59142df50dd5e6688 P 1bae5c017edf4654904bc11aee7147ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:06:11.873536 9322 raft_consensus.cc:740] T 0b2258aecaf246d59142df50dd5e6688 P 1bae5c017edf4654904bc11aee7147ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bae5c017edf4654904bc11aee7147ea, State: Initialized, Role: FOLLOWER
I20260615 08:06:11.872915 9323 ts_tablet_manager.cc:1403] T 0b2258aecaf246d59142df50dd5e6688 P 7c6dc0246eb54fe6bc202fa4faf884aa: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260615 08:06:11.873708 9325 tablet_bootstrap.cc:492] T 0b2258aecaf246d59142df50dd5e6688 P 608b52f585d648799fc291b80dc18cd4: No bootstrap required, opened a new log
I20260615 08:06:11.873744 9323 raft_consensus.cc:359] T 0b2258aecaf246d59142df50dd5e6688 P 7c6dc0246eb54fe6bc202fa4faf884aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bae5c017edf4654904bc11aee7147ea" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 35767 } } peers { permanent_uuid: "7c6dc0246eb54fe6bc202fa4faf884aa" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33073 } } peers { permanent_uuid: "608b52f585d648799fc291b80dc18cd4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42269 } }
I20260615 08:06:11.873775 9325 ts_tablet_manager.cc:1403] T 0b2258aecaf246d59142df50dd5e6688 P 608b52f585d648799fc291b80dc18cd4: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:06:11.873814 9323 raft_consensus.cc:385] T 0b2258aecaf246d59142df50dd5e6688 P 7c6dc0246eb54fe6bc202fa4faf884aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:06:11.873844 9323 raft_consensus.cc:740] T 0b2258aecaf246d59142df50dd5e6688 P 7c6dc0246eb54fe6bc202fa4faf884aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c6dc0246eb54fe6bc202fa4faf884aa, State: Initialized, Role: FOLLOWER
I20260615 08:06:11.873900 9323 consensus_queue.cc:260] T 0b2258aecaf246d59142df50dd5e6688 P 7c6dc0246eb54fe6bc202fa4faf884aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bae5c017edf4654904bc11aee7147ea" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 35767 } } peers { permanent_uuid: "7c6dc0246eb54fe6bc202fa4faf884aa" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33073 } } peers { permanent_uuid: "608b52f585d648799fc291b80dc18cd4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42269 } }
I20260615 08:06:11.873940 9325 raft_consensus.cc:359] T 0b2258aecaf246d59142df50dd5e6688 P 608b52f585d648799fc291b80dc18cd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bae5c017edf4654904bc11aee7147ea" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 35767 } } peers { permanent_uuid: "7c6dc0246eb54fe6bc202fa4faf884aa" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33073 } } peers { permanent_uuid: "608b52f585d648799fc291b80dc18cd4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42269 } }
I20260615 08:06:11.874017 9325 raft_consensus.cc:385] T 0b2258aecaf246d59142df50dd5e6688 P 608b52f585d648799fc291b80dc18cd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:06:11.874047 9325 raft_consensus.cc:740] T 0b2258aecaf246d59142df50dd5e6688 P 608b52f585d648799fc291b80dc18cd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 608b52f585d648799fc291b80dc18cd4, State: Initialized, Role: FOLLOWER
I20260615 08:06:11.874074 9323 ts_tablet_manager.cc:1434] T 0b2258aecaf246d59142df50dd5e6688 P 7c6dc0246eb54fe6bc202fa4faf884aa: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:11.874101 9156 heartbeater.cc:499] Master 127.4.42.254:34025 was elected leader, sending a full tablet report...
I20260615 08:06:11.874145 9325 consensus_queue.cc:260] T 0b2258aecaf246d59142df50dd5e6688 P 608b52f585d648799fc291b80dc18cd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bae5c017edf4654904bc11aee7147ea" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 35767 } } peers { permanent_uuid: "7c6dc0246eb54fe6bc202fa4faf884aa" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33073 } } peers { permanent_uuid: "608b52f585d648799fc291b80dc18cd4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42269 } }
I20260615 08:06:11.874195 9322 consensus_queue.cc:260] T 0b2258aecaf246d59142df50dd5e6688 P 1bae5c017edf4654904bc11aee7147ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bae5c017edf4654904bc11aee7147ea" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 35767 } } peers { permanent_uuid: "7c6dc0246eb54fe6bc202fa4faf884aa" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33073 } } peers { permanent_uuid: "608b52f585d648799fc291b80dc18cd4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42269 } }
I20260615 08:06:11.874297 9325 ts_tablet_manager.cc:1434] T 0b2258aecaf246d59142df50dd5e6688 P 608b52f585d648799fc291b80dc18cd4: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:11.874361 9322 ts_tablet_manager.cc:1434] T 0b2258aecaf246d59142df50dd5e6688 P 1bae5c017edf4654904bc11aee7147ea: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:06:11.874464 9307 heartbeater.cc:499] Master 127.4.42.254:34025 was elected leader, sending a full tablet report...
I20260615 08:06:11.874446 9232 heartbeater.cc:499] Master 127.4.42.254:34025 was elected leader, sending a full tablet report...
I20260615 08:06:12.142680 9328 raft_consensus.cc:493] T 0b2258aecaf246d59142df50dd5e6688 P 7c6dc0246eb54fe6bc202fa4faf884aa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260615 08:06:12.142783 9328 raft_consensus.cc:515] T 0b2258aecaf246d59142df50dd5e6688 P 7c6dc0246eb54fe6bc202fa4faf884aa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bae5c017edf4654904bc11aee7147ea" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 35767 } } peers { permanent_uuid: "7c6dc0246eb54fe6bc202fa4faf884aa" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33073 } } peers { permanent_uuid: "608b52f585d648799fc291b80dc18cd4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42269 } }
I20260615 08:06:12.143014 9328 leader_election.cc:290] T 0b2258aecaf246d59142df50dd5e6688 P 7c6dc0246eb54fe6bc202fa4faf884aa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1bae5c017edf4654904bc11aee7147ea (127.4.42.194:35767), 608b52f585d648799fc291b80dc18cd4 (127.4.42.195:42269)
I20260615 08:06:12.146302 9281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b2258aecaf246d59142df50dd5e6688" candidate_uuid: "7c6dc0246eb54fe6bc202fa4faf884aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "608b52f585d648799fc291b80dc18cd4" is_pre_election: true
I20260615 08:06:12.146337 9206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b2258aecaf246d59142df50dd5e6688" candidate_uuid: "7c6dc0246eb54fe6bc202fa4faf884aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bae5c017edf4654904bc11aee7147ea" is_pre_election: true
I20260615 08:06:12.146392 9281 raft_consensus.cc:2468] T 0b2258aecaf246d59142df50dd5e6688 P 608b52f585d648799fc291b80dc18cd4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c6dc0246eb54fe6bc202fa4faf884aa in term 0.
I20260615 08:06:12.146425 9206 raft_consensus.cc:2468] T 0b2258aecaf246d59142df50dd5e6688 P 1bae5c017edf4654904bc11aee7147ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c6dc0246eb54fe6bc202fa4faf884aa in term 0.
I20260615 08:06:12.146597 9096 leader_election.cc:304] T 0b2258aecaf246d59142df50dd5e6688 P 7c6dc0246eb54fe6bc202fa4faf884aa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 608b52f585d648799fc291b80dc18cd4, 7c6dc0246eb54fe6bc202fa4faf884aa; no voters:
I20260615 08:06:12.146696 9328 raft_consensus.cc:2804] T 0b2258aecaf246d59142df50dd5e6688 P 7c6dc0246eb54fe6bc202fa4faf884aa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260615 08:06:12.146745 9328 raft_consensus.cc:493] T 0b2258aecaf246d59142df50dd5e6688 P 7c6dc0246eb54fe6bc202fa4faf884aa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:06:12.146780 9328 raft_consensus.cc:3060] T 0b2258aecaf246d59142df50dd5e6688 P 7c6dc0246eb54fe6bc202fa4faf884aa [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:06:12.147440 9328 raft_consensus.cc:515] T 0b2258aecaf246d59142df50dd5e6688 P 7c6dc0246eb54fe6bc202fa4faf884aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bae5c017edf4654904bc11aee7147ea" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 35767 } } peers { permanent_uuid: "7c6dc0246eb54fe6bc202fa4faf884aa" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33073 } } peers { permanent_uuid: "608b52f585d648799fc291b80dc18cd4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42269 } }
I20260615 08:06:12.147578 9328 leader_election.cc:290] T 0b2258aecaf246d59142df50dd5e6688 P 7c6dc0246eb54fe6bc202fa4faf884aa [CANDIDATE]: Term 1 election: Requested vote from peers 1bae5c017edf4654904bc11aee7147ea (127.4.42.194:35767), 608b52f585d648799fc291b80dc18cd4 (127.4.42.195:42269)
I20260615 08:06:12.147666 9206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b2258aecaf246d59142df50dd5e6688" candidate_uuid: "7c6dc0246eb54fe6bc202fa4faf884aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bae5c017edf4654904bc11aee7147ea"
I20260615 08:06:12.147707 9281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b2258aecaf246d59142df50dd5e6688" candidate_uuid: "7c6dc0246eb54fe6bc202fa4faf884aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "608b52f585d648799fc291b80dc18cd4"
I20260615 08:06:12.147746 9206 raft_consensus.cc:3060] T 0b2258aecaf246d59142df50dd5e6688 P 1bae5c017edf4654904bc11aee7147ea [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:06:12.147758 9281 raft_consensus.cc:3060] T 0b2258aecaf246d59142df50dd5e6688 P 608b52f585d648799fc291b80dc18cd4 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:06:12.148377 9206 raft_consensus.cc:2468] T 0b2258aecaf246d59142df50dd5e6688 P 1bae5c017edf4654904bc11aee7147ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c6dc0246eb54fe6bc202fa4faf884aa in term 1.
I20260615 08:06:12.148442 9281 raft_consensus.cc:2468] T 0b2258aecaf246d59142df50dd5e6688 P 608b52f585d648799fc291b80dc18cd4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c6dc0246eb54fe6bc202fa4faf884aa in term 1.
I20260615 08:06:12.148569 9093 leader_election.cc:304] T 0b2258aecaf246d59142df50dd5e6688 P 7c6dc0246eb54fe6bc202fa4faf884aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bae5c017edf4654904bc11aee7147ea, 7c6dc0246eb54fe6bc202fa4faf884aa; no voters:
I20260615 08:06:12.148648 9328 raft_consensus.cc:2804] T 0b2258aecaf246d59142df50dd5e6688 P 7c6dc0246eb54fe6bc202fa4faf884aa [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:06:12.148783 9328 raft_consensus.cc:697] T 0b2258aecaf246d59142df50dd5e6688 P 7c6dc0246eb54fe6bc202fa4faf884aa [term 1 LEADER]: Becoming Leader. State: Replica: 7c6dc0246eb54fe6bc202fa4faf884aa, State: Running, Role: LEADER
I20260615 08:06:12.148841 9328 consensus_queue.cc:237] T 0b2258aecaf246d59142df50dd5e6688 P 7c6dc0246eb54fe6bc202fa4faf884aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bae5c017edf4654904bc11aee7147ea" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 35767 } } peers { permanent_uuid: "7c6dc0246eb54fe6bc202fa4faf884aa" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33073 } } peers { permanent_uuid: "608b52f585d648799fc291b80dc18cd4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42269 } }
I20260615 08:06:12.149330 9027 catalog_manager.cc:5696] T 0b2258aecaf246d59142df50dd5e6688 P 7c6dc0246eb54fe6bc202fa4faf884aa reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c6dc0246eb54fe6bc202fa4faf884aa (127.4.42.193). New cstate: current_term: 1 leader_uuid: "7c6dc0246eb54fe6bc202fa4faf884aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bae5c017edf4654904bc11aee7147ea" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 35767 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c6dc0246eb54fe6bc202fa4faf884aa" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "608b52f585d648799fc291b80dc18cd4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42269 } health_report { overall_health: UNKNOWN } } }
I20260615 08:06:12.228160 9281 raft_consensus.cc:1275] T 0b2258aecaf246d59142df50dd5e6688 P 608b52f585d648799fc291b80dc18cd4 [term 1 FOLLOWER]: Refusing update from remote peer 7c6dc0246eb54fe6bc202fa4faf884aa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:06:12.228229 9206 raft_consensus.cc:1275] T 0b2258aecaf246d59142df50dd5e6688 P 1bae5c017edf4654904bc11aee7147ea [term 1 FOLLOWER]: Refusing update from remote peer 7c6dc0246eb54fe6bc202fa4faf884aa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:06:12.228358 9332 consensus_queue.cc:1048] T 0b2258aecaf246d59142df50dd5e6688 P 7c6dc0246eb54fe6bc202fa4faf884aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "608b52f585d648799fc291b80dc18cd4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 42269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:06:12.228475 9328 consensus_queue.cc:1048] T 0b2258aecaf246d59142df50dd5e6688 P 7c6dc0246eb54fe6bc202fa4faf884aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bae5c017edf4654904bc11aee7147ea" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 35767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:06:22.236246 4267 tablet_server.cc:179] TabletServer@127.4.42.193:0 shutting down...
I20260615 08:06:22.238759 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:06:22.238868 4267 tablet_replica.cc:333] T 0b2258aecaf246d59142df50dd5e6688 P 7c6dc0246eb54fe6bc202fa4faf884aa: stopping tablet replica
I20260615 08:06:22.238912 4267 raft_consensus.cc:2243] T 0b2258aecaf246d59142df50dd5e6688 P 7c6dc0246eb54fe6bc202fa4faf884aa [term 1 LEADER]: Raft consensus shutting down.
I20260615 08:06:22.238960 4267 raft_consensus.cc:2272] T 0b2258aecaf246d59142df50dd5e6688 P 7c6dc0246eb54fe6bc202fa4faf884aa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:06:22.246549 4267 tablet_server.cc:196] TabletServer@127.4.42.193:0 shutdown complete.
I20260615 08:06:22.247274 4267 tablet_server.cc:179] TabletServer@127.4.42.194:0 shutting down...
I20260615 08:06:22.249571 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:06:22.249675 4267 tablet_replica.cc:333] T 0b2258aecaf246d59142df50dd5e6688 P 1bae5c017edf4654904bc11aee7147ea: stopping tablet replica
I20260615 08:06:22.249737 4267 raft_consensus.cc:2243] T 0b2258aecaf246d59142df50dd5e6688 P 1bae5c017edf4654904bc11aee7147ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260615 08:06:22.249775 4267 raft_consensus.cc:2272] T 0b2258aecaf246d59142df50dd5e6688 P 1bae5c017edf4654904bc11aee7147ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:06:22.252871 4267 tablet_server.cc:196] TabletServer@127.4.42.194:0 shutdown complete.
I20260615 08:06:22.253646 4267 tablet_server.cc:179] TabletServer@127.4.42.195:0 shutting down...
I20260615 08:06:22.256086 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:06:22.256206 4267 tablet_replica.cc:333] T 0b2258aecaf246d59142df50dd5e6688 P 608b52f585d648799fc291b80dc18cd4: stopping tablet replica
I20260615 08:06:22.256260 4267 raft_consensus.cc:2243] T 0b2258aecaf246d59142df50dd5e6688 P 608b52f585d648799fc291b80dc18cd4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260615 08:06:22.256299 4267 raft_consensus.cc:2272] T 0b2258aecaf246d59142df50dd5e6688 P 608b52f585d648799fc291b80dc18cd4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:06:22.279083 4267 tablet_server.cc:196] TabletServer@127.4.42.195:0 shutdown complete.
I20260615 08:06:22.279724 4267 master.cc:562] Master@127.4.42.254:34025 shutting down...
I20260615 08:06:22.282176 4267 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7177ab3ac61740368f33b8c9dd125711 [term 1 LEADER]: Raft consensus shutting down.
I20260615 08:06:22.282228 4267 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7177ab3ac61740368f33b8c9dd125711 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:06:22.282244 4267 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7177ab3ac61740368f33b8c9dd125711: stopping tablet replica
I20260615 08:06:22.293666 4267 master.cc:584] Master@127.4.42.254:34025 shutdown complete.
[ OK ] TxnParticipantITest.TestTxnSystemClientGetMetadata (10559 ms)
[ RUN ] TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock
I20260615 08:06:22.312445 4267 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.42.254:46747
I20260615 08:06:22.312574 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:06:22.313875 9391 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:22.313995 4267 server_base.cc:1061] running on GCE node
W20260615 08:06:22.314090 9392 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:22.314288 9394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:22.314442 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:06:22.314473 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:06:22.314527 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510782314527 us; error 0 us; skew 500 ppm
I20260615 08:06:22.314965 4267 webserver.cc:533] Webserver started at http://127.4.42.254:46085/ using document root <none> and password file <none>
I20260615 08:06:22.315068 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:06:22.315101 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:06:22.315146 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:06:22.315356 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1781510637089012-4267-0/minicluster-data/master-0-root/instance:
uuid: "446ba55309aa42adae98008149d88849"
format_stamp: "Formatted at 2026-06-15 08:06:22 on dist-test-slave-37n8"
I20260615 08:06:22.316126 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:06:22.316520 9399 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:22.316636 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:22.316682 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1781510637089012-4267-0/minicluster-data/master-0-root
uuid: "446ba55309aa42adae98008149d88849"
format_stamp: "Formatted at 2026-06-15 08:06:22 on dist-test-slave-37n8"
I20260615 08:06:22.316726 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1781510637089012-4267-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1781510637089012-4267-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1781510637089012-4267-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:06:22.333438 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:06:22.333597 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:06:22.336083 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.254:46747
I20260615 08:06:22.341432 9451 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.254:46747 every 8 connection(s)
I20260615 08:06:22.341600 9452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:06:22.342587 9452 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 446ba55309aa42adae98008149d88849: Bootstrap starting.
I20260615 08:06:22.342861 9452 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 446ba55309aa42adae98008149d88849: Neither blocks nor log segments found. Creating new log.
I20260615 08:06:22.343405 9452 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 446ba55309aa42adae98008149d88849: No bootstrap required, opened a new log
I20260615 08:06:22.343546 9452 raft_consensus.cc:359] T 00000000000000000000000000000000 P 446ba55309aa42adae98008149d88849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "446ba55309aa42adae98008149d88849" member_type: VOTER }
I20260615 08:06:22.343590 9452 raft_consensus.cc:385] T 00000000000000000000000000000000 P 446ba55309aa42adae98008149d88849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:06:22.343604 9452 raft_consensus.cc:740] T 00000000000000000000000000000000 P 446ba55309aa42adae98008149d88849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 446ba55309aa42adae98008149d88849, State: Initialized, Role: FOLLOWER
I20260615 08:06:22.343667 9452 consensus_queue.cc:260] T 00000000000000000000000000000000 P 446ba55309aa42adae98008149d88849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "446ba55309aa42adae98008149d88849" member_type: VOTER }
I20260615 08:06:22.343708 9452 raft_consensus.cc:399] T 00000000000000000000000000000000 P 446ba55309aa42adae98008149d88849 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260615 08:06:22.343730 9452 raft_consensus.cc:493] T 00000000000000000000000000000000 P 446ba55309aa42adae98008149d88849 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260615 08:06:22.343757 9452 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 446ba55309aa42adae98008149d88849 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:06:22.344172 9452 raft_consensus.cc:515] T 00000000000000000000000000000000 P 446ba55309aa42adae98008149d88849 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "446ba55309aa42adae98008149d88849" member_type: VOTER }
I20260615 08:06:22.344219 9452 leader_election.cc:304] T 00000000000000000000000000000000 P 446ba55309aa42adae98008149d88849 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 446ba55309aa42adae98008149d88849; no voters:
I20260615 08:06:22.344295 9452 leader_election.cc:290] T 00000000000000000000000000000000 P 446ba55309aa42adae98008149d88849 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260615 08:06:22.344347 9455 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 446ba55309aa42adae98008149d88849 [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:06:22.344429 9452 sys_catalog.cc:565] T 00000000000000000000000000000000 P 446ba55309aa42adae98008149d88849 [sys.catalog]: configured and running, proceeding with master startup.
I20260615 08:06:22.344503 9455 raft_consensus.cc:697] T 00000000000000000000000000000000 P 446ba55309aa42adae98008149d88849 [term 1 LEADER]: Becoming Leader. State: Replica: 446ba55309aa42adae98008149d88849, State: Running, Role: LEADER
I20260615 08:06:22.344585 9455 consensus_queue.cc:237] T 00000000000000000000000000000000 P 446ba55309aa42adae98008149d88849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "446ba55309aa42adae98008149d88849" member_type: VOTER }
I20260615 08:06:22.344815 9456 sys_catalog.cc:455] T 00000000000000000000000000000000 P 446ba55309aa42adae98008149d88849 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "446ba55309aa42adae98008149d88849" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "446ba55309aa42adae98008149d88849" member_type: VOTER } }
I20260615 08:06:22.344828 9457 sys_catalog.cc:455] T 00000000000000000000000000000000 P 446ba55309aa42adae98008149d88849 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 446ba55309aa42adae98008149d88849. Latest consensus state: current_term: 1 leader_uuid: "446ba55309aa42adae98008149d88849" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "446ba55309aa42adae98008149d88849" member_type: VOTER } }
I20260615 08:06:22.344889 9456 sys_catalog.cc:458] T 00000000000000000000000000000000 P 446ba55309aa42adae98008149d88849 [sys.catalog]: This master's current role is: LEADER
I20260615 08:06:22.344907 9457 sys_catalog.cc:458] T 00000000000000000000000000000000 P 446ba55309aa42adae98008149d88849 [sys.catalog]: This master's current role is: LEADER
I20260615 08:06:22.345121 9461 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260615 08:06:22.345278 9461 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260615 08:06:22.345757 9461 catalog_manager.cc:1382] Generated new cluster ID: efb51ab22e054c479fd92053192d7130
I20260615 08:06:22.345811 9461 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260615 08:06:22.345822 4267 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260615 08:06:22.354133 9461 catalog_manager.cc:1405] Generated new certificate authority record
I20260615 08:06:22.354604 9461 catalog_manager.cc:1539] Loading token signing keys...
I20260615 08:06:22.364821 9461 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 446ba55309aa42adae98008149d88849: Generated new TSK 0
I20260615 08:06:22.364925 9461 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260615 08:06:22.377713 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:06:22.379093 9476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:22.379112 9473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:22.379132 9474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:22.379343 4267 server_base.cc:1061] running on GCE node
I20260615 08:06:22.379451 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:06:22.379483 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:06:22.379503 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510782379500 us; error 0 us; skew 500 ppm
I20260615 08:06:22.380038 4267 webserver.cc:533] Webserver started at http://127.4.42.193:38851/ using document root <none> and password file <none>
I20260615 08:06:22.380142 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:06:22.380204 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:06:22.380254 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:06:22.380506 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1781510637089012-4267-0/minicluster-data/ts-0-root/instance:
uuid: "a4c1931ad3504d948ee5604994cd7cff"
format_stamp: "Formatted at 2026-06-15 08:06:22 on dist-test-slave-37n8"
I20260615 08:06:22.381421 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:06:22.381860 9481 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:22.381992 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:22.382050 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1781510637089012-4267-0/minicluster-data/ts-0-root
uuid: "a4c1931ad3504d948ee5604994cd7cff"
format_stamp: "Formatted at 2026-06-15 08:06:22 on dist-test-slave-37n8"
I20260615 08:06:22.382114 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1781510637089012-4267-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1781510637089012-4267-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1781510637089012-4267-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:06:22.412613 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:06:22.412842 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:06:22.413025 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:06:22.413249 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:06:22.413293 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:22.413333 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:06:22.413362 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:22.416576 9544 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.193:45089 every 8 connection(s)
I20260615 08:06:22.416544 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.193:45089
I20260615 08:06:22.417053 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:06:22.418152 9549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:22.418232 9552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:22.418521 4267 server_base.cc:1061] running on GCE node
W20260615 08:06:22.418623 9550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:22.418781 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:06:22.418839 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:06:22.418861 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510782418860 us; error 0 us; skew 500 ppm
I20260615 08:06:22.419596 4267 webserver.cc:533] Webserver started at http://127.4.42.194:45909/ using document root <none> and password file <none>
I20260615 08:06:22.419695 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:06:22.419742 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:06:22.419792 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:06:22.420199 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1781510637089012-4267-0/minicluster-data/ts-1-root/instance:
uuid: "792a8807afb8456eb0024f5b1b0c848e"
format_stamp: "Formatted at 2026-06-15 08:06:22 on dist-test-slave-37n8"
I20260615 08:06:22.421060 9545 heartbeater.cc:344] Connected to a master server at 127.4.42.254:46747
I20260615 08:06:22.421131 9545 heartbeater.cc:461] Registering TS with master...
I20260615 08:06:22.421240 9545 heartbeater.cc:507] Master 127.4.42.254:46747 requested a full tablet report, sending...
I20260615 08:06:22.421465 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:06:22.421495 9416 ts_manager.cc:194] Registered new tserver with Master: a4c1931ad3504d948ee5604994cd7cff (127.4.42.193:45089)
I20260615 08:06:22.422004 9557 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:22.422139 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:22.422188 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1781510637089012-4267-0/minicluster-data/ts-1-root
uuid: "792a8807afb8456eb0024f5b1b0c848e"
format_stamp: "Formatted at 2026-06-15 08:06:22 on dist-test-slave-37n8"
I20260615 08:06:22.422230 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1781510637089012-4267-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1781510637089012-4267-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1781510637089012-4267-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:06:22.422286 9416 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54682
I20260615 08:06:22.446877 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:06:22.447021 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:06:22.447124 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:06:22.447324 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:06:22.447351 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:22.447371 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:06:22.447417 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:22.450438 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.194:42013
I20260615 08:06:22.450526 9620 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.194:42013 every 8 connection(s)
I20260615 08:06:22.450893 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:06:22.451973 9624 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:22.452011 9625 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:22.452195 4267 server_base.cc:1061] running on GCE node
W20260615 08:06:22.452517 9627 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:22.452705 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:06:22.452745 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:06:22.452759 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510782452759 us; error 0 us; skew 500 ppm
I20260615 08:06:22.453289 4267 webserver.cc:533] Webserver started at http://127.4.42.195:34605/ using document root <none> and password file <none>
I20260615 08:06:22.453374 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:06:22.453419 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:06:22.453461 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:06:22.453794 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1781510637089012-4267-0/minicluster-data/ts-2-root/instance:
uuid: "8232a9f50f794838aafee9df11057468"
format_stamp: "Formatted at 2026-06-15 08:06:22 on dist-test-slave-37n8"
I20260615 08:06:22.453949 9621 heartbeater.cc:344] Connected to a master server at 127.4.42.254:46747
I20260615 08:06:22.454012 9621 heartbeater.cc:461] Registering TS with master...
I20260615 08:06:22.454123 9621 heartbeater.cc:507] Master 127.4.42.254:46747 requested a full tablet report, sending...
I20260615 08:06:22.454360 9416 ts_manager.cc:194] Registered new tserver with Master: 792a8807afb8456eb0024f5b1b0c848e (127.4.42.194:42013)
I20260615 08:06:22.454872 9416 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56148
I20260615 08:06:22.454902 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:06:22.455413 9632 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:22.455545 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:22.455586 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1781510637089012-4267-0/minicluster-data/ts-2-root
uuid: "8232a9f50f794838aafee9df11057468"
format_stamp: "Formatted at 2026-06-15 08:06:22 on dist-test-slave-37n8"
I20260615 08:06:22.455613 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1781510637089012-4267-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1781510637089012-4267-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock.1781510637089012-4267-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:06:22.459299 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:06:22.459452 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:06:22.459563 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:06:22.459692 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:06:22.459715 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:22.459733 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:06:22.459745 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:22.462759 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.195:45907
I20260615 08:06:22.462807 9695 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.195:45907 every 8 connection(s)
I20260615 08:06:22.465574 9696 heartbeater.cc:344] Connected to a master server at 127.4.42.254:46747
I20260615 08:06:22.465623 9696 heartbeater.cc:461] Registering TS with master...
I20260615 08:06:22.465718 9696 heartbeater.cc:507] Master 127.4.42.254:46747 requested a full tablet report, sending...
I20260615 08:06:22.465934 9416 ts_manager.cc:194] Registered new tserver with Master: 8232a9f50f794838aafee9df11057468 (127.4.42.195:45907)
I20260615 08:06:22.466248 4267 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.00330068s
I20260615 08:06:22.466257 9416 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56160
I20260615 08:06:22.470716 9416 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56162:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260615 08:06:22.470858 9416 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260615 08:06:22.475509 9660 tablet_service.cc:1511] Processing CreateTablet for tablet a1a4f0e6a55c4246a7b18a56e2b079ca (DEFAULT_TABLE table=test-workload [id=fd651d809a874a4b806c6bc4e0e59f81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:06:22.475625 9660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1a4f0e6a55c4246a7b18a56e2b079ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:06:22.475725 9509 tablet_service.cc:1511] Processing CreateTablet for tablet a1a4f0e6a55c4246a7b18a56e2b079ca (DEFAULT_TABLE table=test-workload [id=fd651d809a874a4b806c6bc4e0e59f81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:06:22.475847 9509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1a4f0e6a55c4246a7b18a56e2b079ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:06:22.475854 9585 tablet_service.cc:1511] Processing CreateTablet for tablet a1a4f0e6a55c4246a7b18a56e2b079ca (DEFAULT_TABLE table=test-workload [id=fd651d809a874a4b806c6bc4e0e59f81]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:06:22.475958 9585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1a4f0e6a55c4246a7b18a56e2b079ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:06:22.476747 9711 tablet_bootstrap.cc:492] T a1a4f0e6a55c4246a7b18a56e2b079ca P 8232a9f50f794838aafee9df11057468: Bootstrap starting.
I20260615 08:06:22.477128 9711 tablet_bootstrap.cc:654] T a1a4f0e6a55c4246a7b18a56e2b079ca P 8232a9f50f794838aafee9df11057468: Neither blocks nor log segments found. Creating new log.
I20260615 08:06:22.477227 9713 tablet_bootstrap.cc:492] T a1a4f0e6a55c4246a7b18a56e2b079ca P a4c1931ad3504d948ee5604994cd7cff: Bootstrap starting.
I20260615 08:06:22.477703 9713 tablet_bootstrap.cc:654] T a1a4f0e6a55c4246a7b18a56e2b079ca P a4c1931ad3504d948ee5604994cd7cff: Neither blocks nor log segments found. Creating new log.
I20260615 08:06:22.478008 9712 tablet_bootstrap.cc:492] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e: Bootstrap starting.
I20260615 08:06:22.478269 9713 tablet_bootstrap.cc:492] T a1a4f0e6a55c4246a7b18a56e2b079ca P a4c1931ad3504d948ee5604994cd7cff: No bootstrap required, opened a new log
I20260615 08:06:22.478312 9713 ts_tablet_manager.cc:1403] T a1a4f0e6a55c4246a7b18a56e2b079ca P a4c1931ad3504d948ee5604994cd7cff: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:06:22.478430 9712 tablet_bootstrap.cc:654] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e: Neither blocks nor log segments found. Creating new log.
I20260615 08:06:22.478462 9713 raft_consensus.cc:359] T a1a4f0e6a55c4246a7b18a56e2b079ca P a4c1931ad3504d948ee5604994cd7cff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8232a9f50f794838aafee9df11057468" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 45907 } } peers { permanent_uuid: "a4c1931ad3504d948ee5604994cd7cff" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 45089 } } peers { permanent_uuid: "792a8807afb8456eb0024f5b1b0c848e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42013 } }
I20260615 08:06:22.478560 9713 raft_consensus.cc:385] T a1a4f0e6a55c4246a7b18a56e2b079ca P a4c1931ad3504d948ee5604994cd7cff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:06:22.478591 9713 raft_consensus.cc:740] T a1a4f0e6a55c4246a7b18a56e2b079ca P a4c1931ad3504d948ee5604994cd7cff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4c1931ad3504d948ee5604994cd7cff, State: Initialized, Role: FOLLOWER
I20260615 08:06:22.478643 9713 consensus_queue.cc:260] T a1a4f0e6a55c4246a7b18a56e2b079ca P a4c1931ad3504d948ee5604994cd7cff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8232a9f50f794838aafee9df11057468" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 45907 } } peers { permanent_uuid: "a4c1931ad3504d948ee5604994cd7cff" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 45089 } } peers { permanent_uuid: "792a8807afb8456eb0024f5b1b0c848e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42013 } }
I20260615 08:06:22.478803 9713 ts_tablet_manager.cc:1434] T a1a4f0e6a55c4246a7b18a56e2b079ca P a4c1931ad3504d948ee5604994cd7cff: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260615 08:06:22.478895 9545 heartbeater.cc:499] Master 127.4.42.254:46747 was elected leader, sending a full tablet report...
I20260615 08:06:22.479009 9712 tablet_bootstrap.cc:492] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e: No bootstrap required, opened a new log
I20260615 08:06:22.479071 9712 ts_tablet_manager.cc:1403] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:06:22.479214 9712 raft_consensus.cc:359] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8232a9f50f794838aafee9df11057468" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 45907 } } peers { permanent_uuid: "a4c1931ad3504d948ee5604994cd7cff" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 45089 } } peers { permanent_uuid: "792a8807afb8456eb0024f5b1b0c848e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42013 } }
I20260615 08:06:22.479274 9712 raft_consensus.cc:385] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:06:22.479287 9712 raft_consensus.cc:740] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 792a8807afb8456eb0024f5b1b0c848e, State: Initialized, Role: FOLLOWER
I20260615 08:06:22.479009 9711 tablet_bootstrap.cc:492] T a1a4f0e6a55c4246a7b18a56e2b079ca P 8232a9f50f794838aafee9df11057468: No bootstrap required, opened a new log
I20260615 08:06:22.479404 9711 ts_tablet_manager.cc:1403] T a1a4f0e6a55c4246a7b18a56e2b079ca P 8232a9f50f794838aafee9df11057468: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260615 08:06:22.479537 9711 raft_consensus.cc:359] T a1a4f0e6a55c4246a7b18a56e2b079ca P 8232a9f50f794838aafee9df11057468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8232a9f50f794838aafee9df11057468" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 45907 } } peers { permanent_uuid: "a4c1931ad3504d948ee5604994cd7cff" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 45089 } } peers { permanent_uuid: "792a8807afb8456eb0024f5b1b0c848e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42013 } }
I20260615 08:06:22.479578 9711 raft_consensus.cc:385] T a1a4f0e6a55c4246a7b18a56e2b079ca P 8232a9f50f794838aafee9df11057468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:06:22.479620 9711 raft_consensus.cc:740] T a1a4f0e6a55c4246a7b18a56e2b079ca P 8232a9f50f794838aafee9df11057468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8232a9f50f794838aafee9df11057468, State: Initialized, Role: FOLLOWER
I20260615 08:06:22.479683 9711 consensus_queue.cc:260] T a1a4f0e6a55c4246a7b18a56e2b079ca P 8232a9f50f794838aafee9df11057468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8232a9f50f794838aafee9df11057468" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 45907 } } peers { permanent_uuid: "a4c1931ad3504d948ee5604994cd7cff" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 45089 } } peers { permanent_uuid: "792a8807afb8456eb0024f5b1b0c848e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42013 } }
I20260615 08:06:22.479822 9711 ts_tablet_manager.cc:1434] T a1a4f0e6a55c4246a7b18a56e2b079ca P 8232a9f50f794838aafee9df11057468: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:22.479838 9696 heartbeater.cc:499] Master 127.4.42.254:46747 was elected leader, sending a full tablet report...
I20260615 08:06:22.479884 9712 consensus_queue.cc:260] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8232a9f50f794838aafee9df11057468" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 45907 } } peers { permanent_uuid: "a4c1931ad3504d948ee5604994cd7cff" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 45089 } } peers { permanent_uuid: "792a8807afb8456eb0024f5b1b0c848e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42013 } }
I20260615 08:06:22.480053 9712 ts_tablet_manager.cc:1434] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260615 08:06:22.480121 9621 heartbeater.cc:499] Master 127.4.42.254:46747 was elected leader, sending a full tablet report...
I20260615 08:06:22.528679 9719 raft_consensus.cc:493] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260615 08:06:22.528765 9719 raft_consensus.cc:515] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8232a9f50f794838aafee9df11057468" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 45907 } } peers { permanent_uuid: "a4c1931ad3504d948ee5604994cd7cff" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 45089 } } peers { permanent_uuid: "792a8807afb8456eb0024f5b1b0c848e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42013 } }
I20260615 08:06:22.528955 9719 leader_election.cc:290] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8232a9f50f794838aafee9df11057468 (127.4.42.195:45907), a4c1931ad3504d948ee5604994cd7cff (127.4.42.193:45089)
I20260615 08:06:22.531590 9670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a4f0e6a55c4246a7b18a56e2b079ca" candidate_uuid: "792a8807afb8456eb0024f5b1b0c848e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8232a9f50f794838aafee9df11057468" is_pre_election: true
I20260615 08:06:22.531685 9670 raft_consensus.cc:2468] T a1a4f0e6a55c4246a7b18a56e2b079ca P 8232a9f50f794838aafee9df11057468 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 792a8807afb8456eb0024f5b1b0c848e in term 0.
I20260615 08:06:22.531689 9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a4f0e6a55c4246a7b18a56e2b079ca" candidate_uuid: "792a8807afb8456eb0024f5b1b0c848e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4c1931ad3504d948ee5604994cd7cff" is_pre_election: true
I20260615 08:06:22.531826 9519 raft_consensus.cc:2468] T a1a4f0e6a55c4246a7b18a56e2b079ca P a4c1931ad3504d948ee5604994cd7cff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 792a8807afb8456eb0024f5b1b0c848e in term 0.
I20260615 08:06:22.531842 9558 leader_election.cc:304] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 792a8807afb8456eb0024f5b1b0c848e, 8232a9f50f794838aafee9df11057468; no voters:
I20260615 08:06:22.531960 9719 raft_consensus.cc:2804] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260615 08:06:22.532003 9719 raft_consensus.cc:493] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:06:22.532034 9719 raft_consensus.cc:3060] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:06:22.532650 9719 raft_consensus.cc:515] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8232a9f50f794838aafee9df11057468" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 45907 } } peers { permanent_uuid: "a4c1931ad3504d948ee5604994cd7cff" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 45089 } } peers { permanent_uuid: "792a8807afb8456eb0024f5b1b0c848e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42013 } }
I20260615 08:06:22.532775 9719 leader_election.cc:290] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e [CANDIDATE]: Term 1 election: Requested vote from peers 8232a9f50f794838aafee9df11057468 (127.4.42.195:45907), a4c1931ad3504d948ee5604994cd7cff (127.4.42.193:45089)
I20260615 08:06:22.532877 9670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a4f0e6a55c4246a7b18a56e2b079ca" candidate_uuid: "792a8807afb8456eb0024f5b1b0c848e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8232a9f50f794838aafee9df11057468"
I20260615 08:06:22.532917 9519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a4f0e6a55c4246a7b18a56e2b079ca" candidate_uuid: "792a8807afb8456eb0024f5b1b0c848e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4c1931ad3504d948ee5604994cd7cff"
I20260615 08:06:22.532979 9670 raft_consensus.cc:3060] T a1a4f0e6a55c4246a7b18a56e2b079ca P 8232a9f50f794838aafee9df11057468 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:06:22.532984 9519 raft_consensus.cc:3060] T a1a4f0e6a55c4246a7b18a56e2b079ca P a4c1931ad3504d948ee5604994cd7cff [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:06:22.533618 9670 raft_consensus.cc:2468] T a1a4f0e6a55c4246a7b18a56e2b079ca P 8232a9f50f794838aafee9df11057468 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 792a8807afb8456eb0024f5b1b0c848e in term 1.
I20260615 08:06:22.533674 9519 raft_consensus.cc:2468] T a1a4f0e6a55c4246a7b18a56e2b079ca P a4c1931ad3504d948ee5604994cd7cff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 792a8807afb8456eb0024f5b1b0c848e in term 1.
I20260615 08:06:22.533825 9561 leader_election.cc:304] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 792a8807afb8456eb0024f5b1b0c848e, a4c1931ad3504d948ee5604994cd7cff; no voters:
I20260615 08:06:22.533946 9719 raft_consensus.cc:2804] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:06:22.534068 9719 raft_consensus.cc:697] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e [term 1 LEADER]: Becoming Leader. State: Replica: 792a8807afb8456eb0024f5b1b0c848e, State: Running, Role: LEADER
I20260615 08:06:22.534138 9719 consensus_queue.cc:237] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8232a9f50f794838aafee9df11057468" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 45907 } } peers { permanent_uuid: "a4c1931ad3504d948ee5604994cd7cff" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 45089 } } peers { permanent_uuid: "792a8807afb8456eb0024f5b1b0c848e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42013 } }
I20260615 08:06:22.534678 9415 catalog_manager.cc:5696] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e reported cstate change: term changed from 0 to 1, leader changed from <none> to 792a8807afb8456eb0024f5b1b0c848e (127.4.42.194). New cstate: current_term: 1 leader_uuid: "792a8807afb8456eb0024f5b1b0c848e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8232a9f50f794838aafee9df11057468" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 45907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4c1931ad3504d948ee5604994cd7cff" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 45089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "792a8807afb8456eb0024f5b1b0c848e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42013 } health_report { overall_health: HEALTHY } } }
I20260615 08:06:22.550900 9519 raft_consensus.cc:1275] T a1a4f0e6a55c4246a7b18a56e2b079ca P a4c1931ad3504d948ee5604994cd7cff [term 1 FOLLOWER]: Refusing update from remote peer 792a8807afb8456eb0024f5b1b0c848e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:06:22.550907 9670 raft_consensus.cc:1275] T a1a4f0e6a55c4246a7b18a56e2b079ca P 8232a9f50f794838aafee9df11057468 [term 1 FOLLOWER]: Refusing update from remote peer 792a8807afb8456eb0024f5b1b0c848e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:06:22.551139 9719 consensus_queue.cc:1048] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e [LEADER]: Connected to new peer: Peer: permanent_uuid: "8232a9f50f794838aafee9df11057468" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 45907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:06:22.551223 9721 consensus_queue.cc:1048] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4c1931ad3504d948ee5604994cd7cff" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 45089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:06:33.089017 9719 raft_consensus.cc:993] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e: : Instructing follower a4c1931ad3504d948ee5604994cd7cff to start an election
I20260615 08:06:33.089116 9719 raft_consensus.cc:1081] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e [term 1 LEADER]: Signalling peer a4c1931ad3504d948ee5604994cd7cff to start an election
I20260615 08:06:33.089298 9518 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1a4f0e6a55c4246a7b18a56e2b079ca"
dest_uuid: "a4c1931ad3504d948ee5604994cd7cff"
from {username='slave'} at 127.0.0.1:57008
I20260615 08:06:33.089396 9518 raft_consensus.cc:493] T a1a4f0e6a55c4246a7b18a56e2b079ca P a4c1931ad3504d948ee5604994cd7cff [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260615 08:06:33.089430 9518 raft_consensus.cc:3060] T a1a4f0e6a55c4246a7b18a56e2b079ca P a4c1931ad3504d948ee5604994cd7cff [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:06:33.090054 9518 raft_consensus.cc:515] T a1a4f0e6a55c4246a7b18a56e2b079ca P a4c1931ad3504d948ee5604994cd7cff [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8232a9f50f794838aafee9df11057468" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 45907 } } peers { permanent_uuid: "a4c1931ad3504d948ee5604994cd7cff" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 45089 } } peers { permanent_uuid: "792a8807afb8456eb0024f5b1b0c848e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42013 } }
I20260615 08:06:33.090235 9518 leader_election.cc:290] T a1a4f0e6a55c4246a7b18a56e2b079ca P a4c1931ad3504d948ee5604994cd7cff [CANDIDATE]: Term 2 election: Requested vote from peers 8232a9f50f794838aafee9df11057468 (127.4.42.195:45907), 792a8807afb8456eb0024f5b1b0c848e (127.4.42.194:42013)
I20260615 08:06:33.093037 9669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a4f0e6a55c4246a7b18a56e2b079ca" candidate_uuid: "a4c1931ad3504d948ee5604994cd7cff" candidate_term: 2 candidate_status { last_received { term: 1 index: 13647 } } ignore_live_leader: true dest_uuid: "8232a9f50f794838aafee9df11057468"
I20260615 08:06:33.093117 9669 raft_consensus.cc:3060] T a1a4f0e6a55c4246a7b18a56e2b079ca P 8232a9f50f794838aafee9df11057468 [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:06:33.093156 9595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a4f0e6a55c4246a7b18a56e2b079ca" candidate_uuid: "a4c1931ad3504d948ee5604994cd7cff" candidate_term: 2 candidate_status { last_received { term: 1 index: 13647 } } ignore_live_leader: true dest_uuid: "792a8807afb8456eb0024f5b1b0c848e"
I20260615 08:06:33.093230 9595 raft_consensus.cc:3055] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e [term 1 LEADER]: Stepping down as leader of term 1
I20260615 08:06:33.093262 9595 raft_consensus.cc:740] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 792a8807afb8456eb0024f5b1b0c848e, State: Running, Role: LEADER
I20260615 08:06:33.093320 9595 consensus_queue.cc:260] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13647, Committed index: 13647, Last appended: 1.13647, Last appended by leader: 13647, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8232a9f50f794838aafee9df11057468" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 45907 } } peers { permanent_uuid: "a4c1931ad3504d948ee5604994cd7cff" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 45089 } } peers { permanent_uuid: "792a8807afb8456eb0024f5b1b0c848e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42013 } }
I20260615 08:06:33.093396 9595 raft_consensus.cc:3060] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:06:33.093819 9669 raft_consensus.cc:2468] T a1a4f0e6a55c4246a7b18a56e2b079ca P 8232a9f50f794838aafee9df11057468 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4c1931ad3504d948ee5604994cd7cff in term 2.
I20260615 08:06:33.094025 9595 raft_consensus.cc:2468] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4c1931ad3504d948ee5604994cd7cff in term 2.
I20260615 08:06:33.094033 9482 leader_election.cc:304] T a1a4f0e6a55c4246a7b18a56e2b079ca P a4c1931ad3504d948ee5604994cd7cff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8232a9f50f794838aafee9df11057468, a4c1931ad3504d948ee5604994cd7cff; no voters:
I20260615 08:06:33.094249 9770 raft_consensus.cc:2804] T a1a4f0e6a55c4246a7b18a56e2b079ca P a4c1931ad3504d948ee5604994cd7cff [term 2 FOLLOWER]: Leader election won for term 2
I20260615 08:06:33.094375 9770 raft_consensus.cc:697] T a1a4f0e6a55c4246a7b18a56e2b079ca P a4c1931ad3504d948ee5604994cd7cff [term 2 LEADER]: Becoming Leader. State: Replica: a4c1931ad3504d948ee5604994cd7cff, State: Running, Role: LEADER
I20260615 08:06:33.094430 9770 consensus_queue.cc:237] T a1a4f0e6a55c4246a7b18a56e2b079ca P a4c1931ad3504d948ee5604994cd7cff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13647, Committed index: 13647, Last appended: 1.13647, Last appended by leader: 13647, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8232a9f50f794838aafee9df11057468" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 45907 } } peers { permanent_uuid: "a4c1931ad3504d948ee5604994cd7cff" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 45089 } } peers { permanent_uuid: "792a8807afb8456eb0024f5b1b0c848e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42013 } }
I20260615 08:06:33.094882 9407 catalog_manager.cc:5696] T a1a4f0e6a55c4246a7b18a56e2b079ca P a4c1931ad3504d948ee5604994cd7cff reported cstate change: term changed from 1 to 2, leader changed from 792a8807afb8456eb0024f5b1b0c848e (127.4.42.194) to a4c1931ad3504d948ee5604994cd7cff (127.4.42.193). New cstate: current_term: 2 leader_uuid: "a4c1931ad3504d948ee5604994cd7cff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8232a9f50f794838aafee9df11057468" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 45907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4c1931ad3504d948ee5604994cd7cff" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 45089 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "792a8807afb8456eb0024f5b1b0c848e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42013 } health_report { overall_health: UNKNOWN } } }
I20260615 08:06:33.104727 9595 raft_consensus.cc:1275] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e [term 2 FOLLOWER]: Refusing update from remote peer a4c1931ad3504d948ee5604994cd7cff: Log matching property violated. Preceding OpId in replica: term: 1 index: 13647. Preceding OpId from leader: term: 2 index: 13649. (index mismatch)
I20260615 08:06:33.104766 9669 raft_consensus.cc:1275] T a1a4f0e6a55c4246a7b18a56e2b079ca P 8232a9f50f794838aafee9df11057468 [term 2 FOLLOWER]: Refusing update from remote peer a4c1931ad3504d948ee5604994cd7cff: Log matching property violated. Preceding OpId in replica: term: 1 index: 13647. Preceding OpId from leader: term: 2 index: 13649. (index mismatch)
I20260615 08:06:33.105072 9770 consensus_queue.cc:1048] T a1a4f0e6a55c4246a7b18a56e2b079ca P a4c1931ad3504d948ee5604994cd7cff [LEADER]: Connected to new peer: Peer: permanent_uuid: "8232a9f50f794838aafee9df11057468" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 45907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13648, Last known committed idx: 13647, Time since last communication: 0.000s
I20260615 08:06:33.105183 9771 consensus_queue.cc:1048] T a1a4f0e6a55c4246a7b18a56e2b079ca P a4c1931ad3504d948ee5604994cd7cff [LEADER]: Connected to new peer: Peer: permanent_uuid: "792a8807afb8456eb0024f5b1b0c848e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13648, Last known committed idx: 13647, Time since last communication: 0.000s
I20260615 08:06:33.109745 4267 tablet_server.cc:179] TabletServer@127.4.42.193:0 shutting down...
I20260615 08:06:33.112821 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:06:33.112941 4267 tablet_replica.cc:333] T a1a4f0e6a55c4246a7b18a56e2b079ca P a4c1931ad3504d948ee5604994cd7cff: stopping tablet replica
I20260615 08:06:33.113016 4267 raft_consensus.cc:2243] T a1a4f0e6a55c4246a7b18a56e2b079ca P a4c1931ad3504d948ee5604994cd7cff [term 2 LEADER]: Raft consensus shutting down.
I20260615 08:06:33.113072 4267 raft_consensus.cc:2272] T a1a4f0e6a55c4246a7b18a56e2b079ca P a4c1931ad3504d948ee5604994cd7cff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:06:33.116700 4267 tablet_server.cc:196] TabletServer@127.4.42.193:0 shutdown complete.
I20260615 08:06:33.117578 4267 tablet_server.cc:179] TabletServer@127.4.42.194:0 shutting down...
I20260615 08:06:33.120846 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:06:33.120971 4267 tablet_replica.cc:333] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e: stopping tablet replica
I20260615 08:06:33.121017 4267 raft_consensus.cc:2243] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260615 08:06:33.121078 4267 raft_consensus.cc:2272] T a1a4f0e6a55c4246a7b18a56e2b079ca P 792a8807afb8456eb0024f5b1b0c848e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:06:33.130650 4267 tablet_server.cc:196] TabletServer@127.4.42.194:0 shutdown complete.
I20260615 08:06:33.131342 4267 tablet_server.cc:179] TabletServer@127.4.42.195:0 shutting down...
I20260615 08:06:33.134979 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:06:33.135113 4267 tablet_replica.cc:333] T a1a4f0e6a55c4246a7b18a56e2b079ca P 8232a9f50f794838aafee9df11057468: stopping tablet replica
I20260615 08:06:33.135149 4267 raft_consensus.cc:2243] T a1a4f0e6a55c4246a7b18a56e2b079ca P 8232a9f50f794838aafee9df11057468 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260615 08:06:33.135178 4267 raft_consensus.cc:2272] T a1a4f0e6a55c4246a7b18a56e2b079ca P 8232a9f50f794838aafee9df11057468 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:06:33.148514 4267 tablet_server.cc:196] TabletServer@127.4.42.195:0 shutdown complete.
I20260615 08:06:33.149398 4267 master.cc:562] Master@127.4.42.254:46747 shutting down...
I20260615 08:06:33.152141 4267 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 446ba55309aa42adae98008149d88849 [term 1 LEADER]: Raft consensus shutting down.
I20260615 08:06:33.152213 4267 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 446ba55309aa42adae98008149d88849 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:06:33.152232 4267 tablet_replica.cc:333] T 00000000000000000000000000000000 P 446ba55309aa42adae98008149d88849: stopping tablet replica
I20260615 08:06:33.163985 4267 master.cc:584] Master@127.4.42.254:46747 shutdown complete.
[ OK ] TxnParticipantITest.TestTxnSystemClientBeginTxnDoesntLock (10870 ms)
[ RUN ] TxnParticipantITest.TestTxnSystemClientCommitSequence
I20260615 08:06:33.182777 4267 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.42.254:41253
I20260615 08:06:33.182971 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:06:33.184137 9792 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:33.184213 9795 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:33.184257 4267 server_base.cc:1061] running on GCE node
W20260615 08:06:33.184211 9793 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:33.184470 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:06:33.184504 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:06:33.184521 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510793184521 us; error 0 us; skew 500 ppm
I20260615 08:06:33.185015 4267 webserver.cc:533] Webserver started at http://127.4.42.254:40287/ using document root <none> and password file <none>
I20260615 08:06:33.185113 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:06:33.185177 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:06:33.185225 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:06:33.185472 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1781510637089012-4267-0/minicluster-data/master-0-root/instance:
uuid: "6a3ad3f30211489fa69afc6fe313aff0"
format_stamp: "Formatted at 2026-06-15 08:06:33 on dist-test-slave-37n8"
I20260615 08:06:33.186337 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:06:33.186869 9800 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:33.187007 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:33.187070 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1781510637089012-4267-0/minicluster-data/master-0-root
uuid: "6a3ad3f30211489fa69afc6fe313aff0"
format_stamp: "Formatted at 2026-06-15 08:06:33 on dist-test-slave-37n8"
I20260615 08:06:33.187114 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1781510637089012-4267-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1781510637089012-4267-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1781510637089012-4267-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:06:33.206703 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:06:33.206884 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:06:33.209429 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.254:41253
I20260615 08:06:33.210522 9852 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.254:41253 every 8 connection(s)
I20260615 08:06:33.221719 9853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:06:33.222854 9853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a3ad3f30211489fa69afc6fe313aff0: Bootstrap starting.
I20260615 08:06:33.223191 9853 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6a3ad3f30211489fa69afc6fe313aff0: Neither blocks nor log segments found. Creating new log.
I20260615 08:06:33.223688 9853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a3ad3f30211489fa69afc6fe313aff0: No bootstrap required, opened a new log
I20260615 08:06:33.223825 9853 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6a3ad3f30211489fa69afc6fe313aff0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a3ad3f30211489fa69afc6fe313aff0" member_type: VOTER }
I20260615 08:06:33.223871 9853 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6a3ad3f30211489fa69afc6fe313aff0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:06:33.223886 9853 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6a3ad3f30211489fa69afc6fe313aff0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a3ad3f30211489fa69afc6fe313aff0, State: Initialized, Role: FOLLOWER
I20260615 08:06:33.223953 9853 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a3ad3f30211489fa69afc6fe313aff0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a3ad3f30211489fa69afc6fe313aff0" member_type: VOTER }
I20260615 08:06:33.223999 9853 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6a3ad3f30211489fa69afc6fe313aff0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260615 08:06:33.224042 9853 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6a3ad3f30211489fa69afc6fe313aff0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260615 08:06:33.224073 9853 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6a3ad3f30211489fa69afc6fe313aff0 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:06:33.224565 9853 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6a3ad3f30211489fa69afc6fe313aff0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a3ad3f30211489fa69afc6fe313aff0" member_type: VOTER }
I20260615 08:06:33.224628 9853 leader_election.cc:304] T 00000000000000000000000000000000 P 6a3ad3f30211489fa69afc6fe313aff0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6a3ad3f30211489fa69afc6fe313aff0; no voters:
I20260615 08:06:33.224741 9853 leader_election.cc:290] T 00000000000000000000000000000000 P 6a3ad3f30211489fa69afc6fe313aff0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260615 08:06:33.224787 9856 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6a3ad3f30211489fa69afc6fe313aff0 [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:06:33.224893 9853 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6a3ad3f30211489fa69afc6fe313aff0 [sys.catalog]: configured and running, proceeding with master startup.
I20260615 08:06:33.224946 9856 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6a3ad3f30211489fa69afc6fe313aff0 [term 1 LEADER]: Becoming Leader. State: Replica: 6a3ad3f30211489fa69afc6fe313aff0, State: Running, Role: LEADER
I20260615 08:06:33.225000 9856 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a3ad3f30211489fa69afc6fe313aff0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a3ad3f30211489fa69afc6fe313aff0" member_type: VOTER }
I20260615 08:06:33.225236 9857 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a3ad3f30211489fa69afc6fe313aff0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6a3ad3f30211489fa69afc6fe313aff0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a3ad3f30211489fa69afc6fe313aff0" member_type: VOTER } }
I20260615 08:06:33.225239 9858 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a3ad3f30211489fa69afc6fe313aff0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a3ad3f30211489fa69afc6fe313aff0. Latest consensus state: current_term: 1 leader_uuid: "6a3ad3f30211489fa69afc6fe313aff0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a3ad3f30211489fa69afc6fe313aff0" member_type: VOTER } }
I20260615 08:06:33.225382 9858 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a3ad3f30211489fa69afc6fe313aff0 [sys.catalog]: This master's current role is: LEADER
I20260615 08:06:33.225339 9857 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a3ad3f30211489fa69afc6fe313aff0 [sys.catalog]: This master's current role is: LEADER
I20260615 08:06:33.225593 9863 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260615 08:06:33.225783 9863 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260615 08:06:33.226315 4267 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260615 08:06:33.226322 9863 catalog_manager.cc:1382] Generated new cluster ID: 566f9a4cfa844f0cbce71bd9ff322fe9
I20260615 08:06:33.226397 9863 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260615 08:06:33.235123 9863 catalog_manager.cc:1405] Generated new certificate authority record
I20260615 08:06:33.235536 9863 catalog_manager.cc:1539] Loading token signing keys...
I20260615 08:06:33.239585 9863 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 6a3ad3f30211489fa69afc6fe313aff0: Generated new TSK 0
I20260615 08:06:33.239656 9863 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260615 08:06:33.242004 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:06:33.243278 9875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:33.243407 4267 server_base.cc:1061] running on GCE node
W20260615 08:06:33.243427 9877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:33.243337 9874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:33.243641 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:06:33.243716 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:06:33.243737 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510793243737 us; error 0 us; skew 500 ppm
I20260615 08:06:33.244242 4267 webserver.cc:533] Webserver started at http://127.4.42.193:37479/ using document root <none> and password file <none>
I20260615 08:06:33.244365 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:06:33.244411 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:06:33.244458 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:06:33.244701 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1781510637089012-4267-0/minicluster-data/ts-0-root/instance:
uuid: "e8c8e1de52b34325b12e94e01a8b16ae"
format_stamp: "Formatted at 2026-06-15 08:06:33 on dist-test-slave-37n8"
I20260615 08:06:33.245554 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:06:33.246053 9882 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:33.246204 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:33.246272 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1781510637089012-4267-0/minicluster-data/ts-0-root
uuid: "e8c8e1de52b34325b12e94e01a8b16ae"
format_stamp: "Formatted at 2026-06-15 08:06:33 on dist-test-slave-37n8"
I20260615 08:06:33.246315 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1781510637089012-4267-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1781510637089012-4267-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1781510637089012-4267-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:06:33.264003 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:06:33.264215 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:06:33.264369 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:06:33.264549 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:06:33.264595 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:33.264631 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:06:33.264653 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:33.267779 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.193:39645
I20260615 08:06:33.268172 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260615 08:06:33.268868 9945 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.193:39645 every 8 connection(s)
W20260615 08:06:33.270143 9948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:33.270299 9949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:33.270440 9951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:33.270890 4267 server_base.cc:1061] running on GCE node
I20260615 08:06:33.271062 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:06:33.271100 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:06:33.271121 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510793271122 us; error 0 us; skew 500 ppm
I20260615 08:06:33.271798 4267 webserver.cc:533] Webserver started at http://127.4.42.194:40779/ using document root <none> and password file <none>
I20260615 08:06:33.271885 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:06:33.271931 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:06:33.271975 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:06:33.272289 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1781510637089012-4267-0/minicluster-data/ts-1-root/instance:
uuid: "deb532fe866f40dd92a2c1ee451ea417"
format_stamp: "Formatted at 2026-06-15 08:06:33 on dist-test-slave-37n8"
I20260615 08:06:33.273183 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:06:33.273845 9958 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:33.273986 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260615 08:06:33.274060 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1781510637089012-4267-0/minicluster-data/ts-1-root
uuid: "deb532fe866f40dd92a2c1ee451ea417"
format_stamp: "Formatted at 2026-06-15 08:06:33 on dist-test-slave-37n8"
I20260615 08:06:33.274107 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1781510637089012-4267-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1781510637089012-4267-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1781510637089012-4267-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:06:33.280589 9946 heartbeater.cc:344] Connected to a master server at 127.4.42.254:41253
I20260615 08:06:33.280655 9946 heartbeater.cc:461] Registering TS with master...
I20260615 08:06:33.280764 9946 heartbeater.cc:507] Master 127.4.42.254:41253 requested a full tablet report, sending...
I20260615 08:06:33.281020 9817 ts_manager.cc:194] Registered new tserver with Master: e8c8e1de52b34325b12e94e01a8b16ae (127.4.42.193:39645)
I20260615 08:06:33.281594 9817 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56408
I20260615 08:06:33.285840 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:06:33.286022 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:06:33.286175 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:06:33.286365 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:06:33.286410 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:33.286463 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:06:33.286504 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:33.289556 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.194:42913
I20260615 08:06:33.289624 10021 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.194:42913 every 8 connection(s)
I20260615 08:06:33.289947 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:06:33.290894 10026 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:33.291004 10025 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:33.291230 4267 server_base.cc:1061] running on GCE node
W20260615 08:06:33.291388 10028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:33.291611 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:06:33.291678 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:06:33.291700 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510793291701 us; error 0 us; skew 500 ppm
I20260615 08:06:33.292323 4267 webserver.cc:533] Webserver started at http://127.4.42.195:43533/ using document root <none> and password file <none>
I20260615 08:06:33.292408 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:06:33.292460 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:06:33.292515 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:06:33.292809 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1781510637089012-4267-0/minicluster-data/ts-2-root/instance:
uuid: "e8798f394e7046f19e3ccdc6447bb4c3"
format_stamp: "Formatted at 2026-06-15 08:06:33 on dist-test-slave-37n8"
I20260615 08:06:33.293021 10022 heartbeater.cc:344] Connected to a master server at 127.4.42.254:41253
I20260615 08:06:33.293083 10022 heartbeater.cc:461] Registering TS with master...
I20260615 08:06:33.293196 10022 heartbeater.cc:507] Master 127.4.42.254:41253 requested a full tablet report, sending...
I20260615 08:06:33.293416 9817 ts_manager.cc:194] Registered new tserver with Master: deb532fe866f40dd92a2c1ee451ea417 (127.4.42.194:42913)
I20260615 08:06:33.293767 9817 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56422
I20260615 08:06:33.293954 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260615 08:06:33.294462 10033 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:33.294641 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:33.294682 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1781510637089012-4267-0/minicluster-data/ts-2-root
uuid: "e8798f394e7046f19e3ccdc6447bb4c3"
format_stamp: "Formatted at 2026-06-15 08:06:33 on dist-test-slave-37n8"
I20260615 08:06:33.294708 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1781510637089012-4267-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1781510637089012-4267-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientCommitSequence.1781510637089012-4267-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:06:33.308354 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:06:33.308517 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:06:33.308629 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:06:33.308841 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:06:33.308866 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:33.308915 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:06:33.308941 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:33.312029 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.195:37053
I20260615 08:06:33.312088 10096 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.195:37053 every 8 connection(s)
I20260615 08:06:33.314965 10097 heartbeater.cc:344] Connected to a master server at 127.4.42.254:41253
I20260615 08:06:33.315076 10097 heartbeater.cc:461] Registering TS with master...
I20260615 08:06:33.315164 10097 heartbeater.cc:507] Master 127.4.42.254:41253 requested a full tablet report, sending...
I20260615 08:06:33.315413 9817 ts_manager.cc:194] Registered new tserver with Master: e8798f394e7046f19e3ccdc6447bb4c3 (127.4.42.195:37053)
I20260615 08:06:33.315637 4267 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003365457s
I20260615 08:06:33.315850 9817 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56432
I20260615 08:06:33.320261 9817 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56446:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260615 08:06:33.320367 9817 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260615 08:06:33.324712 9986 tablet_service.cc:1511] Processing CreateTablet for tablet 2c95611604d94cc88f9107acde308927 (DEFAULT_TABLE table=test-workload [id=baf6cf5265c14f258597f730ba593d0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:06:33.324833 9986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c95611604d94cc88f9107acde308927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:06:33.325121 10061 tablet_service.cc:1511] Processing CreateTablet for tablet 2c95611604d94cc88f9107acde308927 (DEFAULT_TABLE table=test-workload [id=baf6cf5265c14f258597f730ba593d0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:06:33.325121 9910 tablet_service.cc:1511] Processing CreateTablet for tablet 2c95611604d94cc88f9107acde308927 (DEFAULT_TABLE table=test-workload [id=baf6cf5265c14f258597f730ba593d0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:06:33.325255 9910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c95611604d94cc88f9107acde308927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:06:33.325256 10061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c95611604d94cc88f9107acde308927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:06:33.326078 10112 tablet_bootstrap.cc:492] T 2c95611604d94cc88f9107acde308927 P deb532fe866f40dd92a2c1ee451ea417: Bootstrap starting.
I20260615 08:06:33.326681 10112 tablet_bootstrap.cc:654] T 2c95611604d94cc88f9107acde308927 P deb532fe866f40dd92a2c1ee451ea417: Neither blocks nor log segments found. Creating new log.
I20260615 08:06:33.326726 10114 tablet_bootstrap.cc:492] T 2c95611604d94cc88f9107acde308927 P e8c8e1de52b34325b12e94e01a8b16ae: Bootstrap starting.
I20260615 08:06:33.326740 10113 tablet_bootstrap.cc:492] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3: Bootstrap starting.
I20260615 08:06:33.327168 10114 tablet_bootstrap.cc:654] T 2c95611604d94cc88f9107acde308927 P e8c8e1de52b34325b12e94e01a8b16ae: Neither blocks nor log segments found. Creating new log.
I20260615 08:06:33.327229 10113 tablet_bootstrap.cc:654] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3: Neither blocks nor log segments found. Creating new log.
I20260615 08:06:33.327346 10112 tablet_bootstrap.cc:492] T 2c95611604d94cc88f9107acde308927 P deb532fe866f40dd92a2c1ee451ea417: No bootstrap required, opened a new log
I20260615 08:06:33.327401 10112 ts_tablet_manager.cc:1403] T 2c95611604d94cc88f9107acde308927 P deb532fe866f40dd92a2c1ee451ea417: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260615 08:06:33.327566 10112 raft_consensus.cc:359] T 2c95611604d94cc88f9107acde308927 P deb532fe866f40dd92a2c1ee451ea417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8c8e1de52b34325b12e94e01a8b16ae" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39645 } } peers { permanent_uuid: "deb532fe866f40dd92a2c1ee451ea417" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42913 } } peers { permanent_uuid: "e8798f394e7046f19e3ccdc6447bb4c3" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 37053 } }
I20260615 08:06:33.327644 10112 raft_consensus.cc:385] T 2c95611604d94cc88f9107acde308927 P deb532fe866f40dd92a2c1ee451ea417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:06:33.327670 10112 raft_consensus.cc:740] T 2c95611604d94cc88f9107acde308927 P deb532fe866f40dd92a2c1ee451ea417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: deb532fe866f40dd92a2c1ee451ea417, State: Initialized, Role: FOLLOWER
I20260615 08:06:33.327741 10112 consensus_queue.cc:260] T 2c95611604d94cc88f9107acde308927 P deb532fe866f40dd92a2c1ee451ea417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8c8e1de52b34325b12e94e01a8b16ae" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39645 } } peers { permanent_uuid: "deb532fe866f40dd92a2c1ee451ea417" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42913 } } peers { permanent_uuid: "e8798f394e7046f19e3ccdc6447bb4c3" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 37053 } }
I20260615 08:06:33.327827 10114 tablet_bootstrap.cc:492] T 2c95611604d94cc88f9107acde308927 P e8c8e1de52b34325b12e94e01a8b16ae: No bootstrap required, opened a new log
I20260615 08:06:33.327868 10113 tablet_bootstrap.cc:492] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3: No bootstrap required, opened a new log
I20260615 08:06:33.327879 10114 ts_tablet_manager.cc:1403] T 2c95611604d94cc88f9107acde308927 P e8c8e1de52b34325b12e94e01a8b16ae: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:06:33.327903 10113 ts_tablet_manager.cc:1403] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:06:33.327934 10112 ts_tablet_manager.cc:1434] T 2c95611604d94cc88f9107acde308927 P deb532fe866f40dd92a2c1ee451ea417: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260615 08:06:33.328006 10022 heartbeater.cc:499] Master 127.4.42.254:41253 was elected leader, sending a full tablet report...
I20260615 08:06:33.328032 10114 raft_consensus.cc:359] T 2c95611604d94cc88f9107acde308927 P e8c8e1de52b34325b12e94e01a8b16ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8c8e1de52b34325b12e94e01a8b16ae" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39645 } } peers { permanent_uuid: "deb532fe866f40dd92a2c1ee451ea417" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42913 } } peers { permanent_uuid: "e8798f394e7046f19e3ccdc6447bb4c3" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 37053 } }
I20260615 08:06:33.328032 10113 raft_consensus.cc:359] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8c8e1de52b34325b12e94e01a8b16ae" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39645 } } peers { permanent_uuid: "deb532fe866f40dd92a2c1ee451ea417" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42913 } } peers { permanent_uuid: "e8798f394e7046f19e3ccdc6447bb4c3" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 37053 } }
I20260615 08:06:33.328127 10114 raft_consensus.cc:385] T 2c95611604d94cc88f9107acde308927 P e8c8e1de52b34325b12e94e01a8b16ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:06:33.328137 10113 raft_consensus.cc:385] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:06:33.328168 10114 raft_consensus.cc:740] T 2c95611604d94cc88f9107acde308927 P e8c8e1de52b34325b12e94e01a8b16ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8c8e1de52b34325b12e94e01a8b16ae, State: Initialized, Role: FOLLOWER
I20260615 08:06:33.328176 10113 raft_consensus.cc:740] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8798f394e7046f19e3ccdc6447bb4c3, State: Initialized, Role: FOLLOWER
I20260615 08:06:33.328230 10114 consensus_queue.cc:260] T 2c95611604d94cc88f9107acde308927 P e8c8e1de52b34325b12e94e01a8b16ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8c8e1de52b34325b12e94e01a8b16ae" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39645 } } peers { permanent_uuid: "deb532fe866f40dd92a2c1ee451ea417" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42913 } } peers { permanent_uuid: "e8798f394e7046f19e3ccdc6447bb4c3" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 37053 } }
I20260615 08:06:33.328249 10113 consensus_queue.cc:260] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8c8e1de52b34325b12e94e01a8b16ae" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39645 } } peers { permanent_uuid: "deb532fe866f40dd92a2c1ee451ea417" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42913 } } peers { permanent_uuid: "e8798f394e7046f19e3ccdc6447bb4c3" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 37053 } }
I20260615 08:06:33.328384 10113 ts_tablet_manager.cc:1434] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260615 08:06:33.328384 10114 ts_tablet_manager.cc:1434] T 2c95611604d94cc88f9107acde308927 P e8c8e1de52b34325b12e94e01a8b16ae: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:33.328475 10097 heartbeater.cc:499] Master 127.4.42.254:41253 was elected leader, sending a full tablet report...
I20260615 08:06:33.328528 9946 heartbeater.cc:499] Master 127.4.42.254:41253 was elected leader, sending a full tablet report...
I20260615 08:06:33.347273 10120 raft_consensus.cc:493] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260615 08:06:33.347324 10120 raft_consensus.cc:515] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8c8e1de52b34325b12e94e01a8b16ae" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39645 } } peers { permanent_uuid: "deb532fe866f40dd92a2c1ee451ea417" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42913 } } peers { permanent_uuid: "e8798f394e7046f19e3ccdc6447bb4c3" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 37053 } }
I20260615 08:06:33.347469 10120 leader_election.cc:290] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8c8e1de52b34325b12e94e01a8b16ae (127.4.42.193:39645), deb532fe866f40dd92a2c1ee451ea417 (127.4.42.194:42913)
I20260615 08:06:33.349856 9920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c95611604d94cc88f9107acde308927" candidate_uuid: "e8798f394e7046f19e3ccdc6447bb4c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8c8e1de52b34325b12e94e01a8b16ae" is_pre_election: true
I20260615 08:06:33.349936 9920 raft_consensus.cc:2468] T 2c95611604d94cc88f9107acde308927 P e8c8e1de52b34325b12e94e01a8b16ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8798f394e7046f19e3ccdc6447bb4c3 in term 0.
I20260615 08:06:33.349968 9996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c95611604d94cc88f9107acde308927" candidate_uuid: "e8798f394e7046f19e3ccdc6447bb4c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deb532fe866f40dd92a2c1ee451ea417" is_pre_election: true
I20260615 08:06:33.350041 9996 raft_consensus.cc:2468] T 2c95611604d94cc88f9107acde308927 P deb532fe866f40dd92a2c1ee451ea417 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8798f394e7046f19e3ccdc6447bb4c3 in term 0.
I20260615 08:06:33.350067 10037 leader_election.cc:304] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8798f394e7046f19e3ccdc6447bb4c3, e8c8e1de52b34325b12e94e01a8b16ae; no voters:
I20260615 08:06:33.350160 10120 raft_consensus.cc:2804] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260615 08:06:33.350215 10120 raft_consensus.cc:493] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:06:33.350240 10120 raft_consensus.cc:3060] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:06:33.350839 10120 raft_consensus.cc:515] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8c8e1de52b34325b12e94e01a8b16ae" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39645 } } peers { permanent_uuid: "deb532fe866f40dd92a2c1ee451ea417" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42913 } } peers { permanent_uuid: "e8798f394e7046f19e3ccdc6447bb4c3" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 37053 } }
I20260615 08:06:33.350983 10120 leader_election.cc:290] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3 [CANDIDATE]: Term 1 election: Requested vote from peers e8c8e1de52b34325b12e94e01a8b16ae (127.4.42.193:39645), deb532fe866f40dd92a2c1ee451ea417 (127.4.42.194:42913)
I20260615 08:06:33.351114 9920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c95611604d94cc88f9107acde308927" candidate_uuid: "e8798f394e7046f19e3ccdc6447bb4c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8c8e1de52b34325b12e94e01a8b16ae"
I20260615 08:06:33.351178 9920 raft_consensus.cc:3060] T 2c95611604d94cc88f9107acde308927 P e8c8e1de52b34325b12e94e01a8b16ae [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:06:33.351696 9920 raft_consensus.cc:2468] T 2c95611604d94cc88f9107acde308927 P e8c8e1de52b34325b12e94e01a8b16ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8798f394e7046f19e3ccdc6447bb4c3 in term 1.
I20260615 08:06:33.351831 9996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c95611604d94cc88f9107acde308927" candidate_uuid: "e8798f394e7046f19e3ccdc6447bb4c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "deb532fe866f40dd92a2c1ee451ea417"
I20260615 08:06:33.351890 9996 raft_consensus.cc:3060] T 2c95611604d94cc88f9107acde308927 P deb532fe866f40dd92a2c1ee451ea417 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:06:33.351907 10037 leader_election.cc:304] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8798f394e7046f19e3ccdc6447bb4c3, e8c8e1de52b34325b12e94e01a8b16ae; no voters:
I20260615 08:06:33.351984 10120 raft_consensus.cc:2804] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:06:33.352134 10120 raft_consensus.cc:697] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3 [term 1 LEADER]: Becoming Leader. State: Replica: e8798f394e7046f19e3ccdc6447bb4c3, State: Running, Role: LEADER
I20260615 08:06:33.352213 10120 consensus_queue.cc:237] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8c8e1de52b34325b12e94e01a8b16ae" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39645 } } peers { permanent_uuid: "deb532fe866f40dd92a2c1ee451ea417" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42913 } } peers { permanent_uuid: "e8798f394e7046f19e3ccdc6447bb4c3" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 37053 } }
I20260615 08:06:33.352596 9996 raft_consensus.cc:2468] T 2c95611604d94cc88f9107acde308927 P deb532fe866f40dd92a2c1ee451ea417 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8798f394e7046f19e3ccdc6447bb4c3 in term 1.
I20260615 08:06:33.352712 9817 catalog_manager.cc:5696] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8798f394e7046f19e3ccdc6447bb4c3 (127.4.42.195). New cstate: current_term: 1 leader_uuid: "e8798f394e7046f19e3ccdc6447bb4c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8c8e1de52b34325b12e94e01a8b16ae" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "deb532fe866f40dd92a2c1ee451ea417" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8798f394e7046f19e3ccdc6447bb4c3" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 37053 } health_report { overall_health: HEALTHY } } }
I20260615 08:06:33.370985 9996 raft_consensus.cc:1275] T 2c95611604d94cc88f9107acde308927 P deb532fe866f40dd92a2c1ee451ea417 [term 1 FOLLOWER]: Refusing update from remote peer e8798f394e7046f19e3ccdc6447bb4c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:06:33.370986 9920 raft_consensus.cc:1275] T 2c95611604d94cc88f9107acde308927 P e8c8e1de52b34325b12e94e01a8b16ae [term 1 FOLLOWER]: Refusing update from remote peer e8798f394e7046f19e3ccdc6447bb4c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:06:33.371275 10120 consensus_queue.cc:1048] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8c8e1de52b34325b12e94e01a8b16ae" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:06:33.371395 10122 consensus_queue.cc:1048] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "deb532fe866f40dd92a2c1ee451ea417" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:06:43.874085 10147 raft_consensus.cc:993] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3: : Instructing follower e8c8e1de52b34325b12e94e01a8b16ae to start an election
I20260615 08:06:43.874163 10147 raft_consensus.cc:1081] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3 [term 1 LEADER]: Signalling peer e8c8e1de52b34325b12e94e01a8b16ae to start an election
I20260615 08:06:43.874361 9919 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c95611604d94cc88f9107acde308927"
dest_uuid: "e8c8e1de52b34325b12e94e01a8b16ae"
from {username='slave'} at 127.0.0.1:38470
I20260615 08:06:43.874450 9919 raft_consensus.cc:493] T 2c95611604d94cc88f9107acde308927 P e8c8e1de52b34325b12e94e01a8b16ae [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260615 08:06:43.874472 9919 raft_consensus.cc:3060] T 2c95611604d94cc88f9107acde308927 P e8c8e1de52b34325b12e94e01a8b16ae [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:06:43.876056 9919 raft_consensus.cc:515] T 2c95611604d94cc88f9107acde308927 P e8c8e1de52b34325b12e94e01a8b16ae [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8c8e1de52b34325b12e94e01a8b16ae" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39645 } } peers { permanent_uuid: "deb532fe866f40dd92a2c1ee451ea417" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42913 } } peers { permanent_uuid: "e8798f394e7046f19e3ccdc6447bb4c3" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 37053 } }
I20260615 08:06:43.876272 9919 leader_election.cc:290] T 2c95611604d94cc88f9107acde308927 P e8c8e1de52b34325b12e94e01a8b16ae [CANDIDATE]: Term 2 election: Requested vote from peers deb532fe866f40dd92a2c1ee451ea417 (127.4.42.194:42913), e8798f394e7046f19e3ccdc6447bb4c3 (127.4.42.195:37053)
I20260615 08:06:43.879314 10071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c95611604d94cc88f9107acde308927" candidate_uuid: "e8c8e1de52b34325b12e94e01a8b16ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 13911 } } ignore_live_leader: true dest_uuid: "e8798f394e7046f19e3ccdc6447bb4c3"
I20260615 08:06:43.879400 10071 raft_consensus.cc:3055] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260615 08:06:43.879383 9996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c95611604d94cc88f9107acde308927" candidate_uuid: "e8c8e1de52b34325b12e94e01a8b16ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 13911 } } ignore_live_leader: true dest_uuid: "deb532fe866f40dd92a2c1ee451ea417"
I20260615 08:06:43.879472 10071 raft_consensus.cc:740] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8798f394e7046f19e3ccdc6447bb4c3, State: Running, Role: LEADER
I20260615 08:06:43.879494 9996 raft_consensus.cc:3060] T 2c95611604d94cc88f9107acde308927 P deb532fe866f40dd92a2c1ee451ea417 [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:06:43.879530 10071 consensus_queue.cc:260] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13911, Committed index: 13911, Last appended: 1.13911, Last appended by leader: 13911, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8c8e1de52b34325b12e94e01a8b16ae" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39645 } } peers { permanent_uuid: "deb532fe866f40dd92a2c1ee451ea417" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42913 } } peers { permanent_uuid: "e8798f394e7046f19e3ccdc6447bb4c3" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 37053 } }
I20260615 08:06:43.879621 10071 raft_consensus.cc:3060] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3 [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:06:43.880064 9996 raft_consensus.cc:2468] T 2c95611604d94cc88f9107acde308927 P deb532fe866f40dd92a2c1ee451ea417 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8c8e1de52b34325b12e94e01a8b16ae in term 2.
I20260615 08:06:43.880220 10071 raft_consensus.cc:2468] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8c8e1de52b34325b12e94e01a8b16ae in term 2.
I20260615 08:06:43.880229 9883 leader_election.cc:304] T 2c95611604d94cc88f9107acde308927 P e8c8e1de52b34325b12e94e01a8b16ae [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: deb532fe866f40dd92a2c1ee451ea417, e8c8e1de52b34325b12e94e01a8b16ae; no voters:
I20260615 08:06:43.880501 10170 raft_consensus.cc:2804] T 2c95611604d94cc88f9107acde308927 P e8c8e1de52b34325b12e94e01a8b16ae [term 2 FOLLOWER]: Leader election won for term 2
I20260615 08:06:43.880591 10170 raft_consensus.cc:697] T 2c95611604d94cc88f9107acde308927 P e8c8e1de52b34325b12e94e01a8b16ae [term 2 LEADER]: Becoming Leader. State: Replica: e8c8e1de52b34325b12e94e01a8b16ae, State: Running, Role: LEADER
I20260615 08:06:43.880656 10170 consensus_queue.cc:237] T 2c95611604d94cc88f9107acde308927 P e8c8e1de52b34325b12e94e01a8b16ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13911, Committed index: 13911, Last appended: 1.13911, Last appended by leader: 13911, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8c8e1de52b34325b12e94e01a8b16ae" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39645 } } peers { permanent_uuid: "deb532fe866f40dd92a2c1ee451ea417" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42913 } } peers { permanent_uuid: "e8798f394e7046f19e3ccdc6447bb4c3" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 37053 } }
I20260615 08:06:43.881120 9817 catalog_manager.cc:5696] T 2c95611604d94cc88f9107acde308927 P e8c8e1de52b34325b12e94e01a8b16ae reported cstate change: term changed from 1 to 2, leader changed from e8798f394e7046f19e3ccdc6447bb4c3 (127.4.42.195) to e8c8e1de52b34325b12e94e01a8b16ae (127.4.42.193). New cstate: current_term: 2 leader_uuid: "e8c8e1de52b34325b12e94e01a8b16ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8c8e1de52b34325b12e94e01a8b16ae" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "deb532fe866f40dd92a2c1ee451ea417" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42913 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8798f394e7046f19e3ccdc6447bb4c3" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 37053 } health_report { overall_health: UNKNOWN } } }
I20260615 08:06:43.893544 9996 raft_consensus.cc:1275] T 2c95611604d94cc88f9107acde308927 P deb532fe866f40dd92a2c1ee451ea417 [term 2 FOLLOWER]: Refusing update from remote peer e8c8e1de52b34325b12e94e01a8b16ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 13911. Preceding OpId from leader: term: 2 index: 13913. (index mismatch)
I20260615 08:06:43.893545 10071 raft_consensus.cc:1275] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3 [term 2 FOLLOWER]: Refusing update from remote peer e8c8e1de52b34325b12e94e01a8b16ae: Log matching property violated. Preceding OpId in replica: term: 1 index: 13911. Preceding OpId from leader: term: 2 index: 13913. (index mismatch)
I20260615 08:06:43.893748 10170 consensus_queue.cc:1048] T 2c95611604d94cc88f9107acde308927 P e8c8e1de52b34325b12e94e01a8b16ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "deb532fe866f40dd92a2c1ee451ea417" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13912, Last known committed idx: 13911, Time since last communication: 0.000s
I20260615 08:06:43.893887 10171 consensus_queue.cc:1048] T 2c95611604d94cc88f9107acde308927 P e8c8e1de52b34325b12e94e01a8b16ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8798f394e7046f19e3ccdc6447bb4c3" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 37053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13912, Last known committed idx: 13911, Time since last communication: 0.000s
I20260615 08:06:43.894768 10184 mvcc.cc:204] Tried to move back new op lower bound from 7297068252746862592 to 7297068252695740416. Current Snapshot: MvccSnapshot[applied={T|T < 7297068252746862592}]
W20260615 08:06:43.896840 10184 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41752: Illegal state: Cannot finalize transaction in state: OPEN
W20260615 08:06:43.897234 10184 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41752: Illegal state: Transaction 0 already open
W20260615 08:06:43.898593 10184 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41752: Illegal state: Transaction metadata for transaction 0 already exists
W20260615 08:06:43.898988 10184 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41752: Illegal state: Transaction 0 commit already in progress
W20260615 08:06:43.901417 10184 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41752: Illegal state: Transaction metadata for transaction 0 already exists
W20260615 08:06:43.901798 10184 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41752: Illegal state: Transaction metadata for transaction 0 already exists
W20260615 08:06:43.902199 10184 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41752: Illegal state: Transaction 0 commit already in progress
W20260615 08:06:43.902619 10184 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:41752: Illegal state: Transaction metadata for transaction 0 already set
I20260615 08:06:43.902987 4267 tablet_server.cc:179] TabletServer@127.4.42.193:0 shutting down...
I20260615 08:06:43.905774 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:06:43.905874 4267 tablet_replica.cc:333] T 2c95611604d94cc88f9107acde308927 P e8c8e1de52b34325b12e94e01a8b16ae: stopping tablet replica
I20260615 08:06:43.905937 4267 raft_consensus.cc:2243] T 2c95611604d94cc88f9107acde308927 P e8c8e1de52b34325b12e94e01a8b16ae [term 2 LEADER]: Raft consensus shutting down.
I20260615 08:06:43.905995 4267 raft_consensus.cc:2272] T 2c95611604d94cc88f9107acde308927 P e8c8e1de52b34325b12e94e01a8b16ae [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:06:43.920186 4267 tablet_server.cc:196] TabletServer@127.4.42.193:0 shutdown complete.
I20260615 08:06:43.920976 4267 tablet_server.cc:179] TabletServer@127.4.42.194:0 shutting down...
I20260615 08:06:43.924623 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:06:43.924726 4267 tablet_replica.cc:333] T 2c95611604d94cc88f9107acde308927 P deb532fe866f40dd92a2c1ee451ea417: stopping tablet replica
I20260615 08:06:43.924783 4267 raft_consensus.cc:2243] T 2c95611604d94cc88f9107acde308927 P deb532fe866f40dd92a2c1ee451ea417 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260615 08:06:43.924824 4267 raft_consensus.cc:2272] T 2c95611604d94cc88f9107acde308927 P deb532fe866f40dd92a2c1ee451ea417 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:06:43.944677 4267 tablet_server.cc:196] TabletServer@127.4.42.194:0 shutdown complete.
I20260615 08:06:43.945567 4267 tablet_server.cc:179] TabletServer@127.4.42.195:0 shutting down...
I20260615 08:06:43.949751 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:06:43.949859 4267 tablet_replica.cc:333] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3: stopping tablet replica
I20260615 08:06:43.949915 4267 raft_consensus.cc:2243] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260615 08:06:43.949958 4267 raft_consensus.cc:2272] T 2c95611604d94cc88f9107acde308927 P e8798f394e7046f19e3ccdc6447bb4c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:06:43.953908 4267 tablet_server.cc:196] TabletServer@127.4.42.195:0 shutdown complete.
I20260615 08:06:43.954694 4267 master.cc:562] Master@127.4.42.254:41253 shutting down...
I20260615 08:06:43.957242 4267 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6a3ad3f30211489fa69afc6fe313aff0 [term 1 LEADER]: Raft consensus shutting down.
I20260615 08:06:43.957301 4267 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6a3ad3f30211489fa69afc6fe313aff0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:06:43.957336 4267 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6a3ad3f30211489fa69afc6fe313aff0: stopping tablet replica
I20260615 08:06:43.970707 4267 master.cc:584] Master@127.4.42.254:41253 shutdown complete.
[ OK ] TxnParticipantITest.TestTxnSystemClientCommitSequence (10806 ms)
[ RUN ] TxnParticipantITest.TestTxnSystemClientAbortSequence
I20260615 08:06:43.988816 4267 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.42.254:44749
I20260615 08:06:43.988981 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:06:43.990574 10192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:43.990705 10195 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:43.990726 4267 server_base.cc:1061] running on GCE node
W20260615 08:06:43.990788 10193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:43.990931 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:06:43.990972 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:06:43.990985 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510803990986 us; error 0 us; skew 500 ppm
I20260615 08:06:43.991545 4267 webserver.cc:533] Webserver started at http://127.4.42.254:36427/ using document root <none> and password file <none>
I20260615 08:06:43.991633 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:06:43.991675 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:06:43.991708 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:06:43.991930 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1781510637089012-4267-0/minicluster-data/master-0-root/instance:
uuid: "5299d591cd894378b078b8ce3439e910"
format_stamp: "Formatted at 2026-06-15 08:06:43 on dist-test-slave-37n8"
I20260615 08:06:43.992759 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:06:43.993331 10200 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:43.993479 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:43.993530 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1781510637089012-4267-0/minicluster-data/master-0-root
uuid: "5299d591cd894378b078b8ce3439e910"
format_stamp: "Formatted at 2026-06-15 08:06:43 on dist-test-slave-37n8"
I20260615 08:06:43.993573 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1781510637089012-4267-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1781510637089012-4267-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1781510637089012-4267-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:06:44.017378 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:06:44.017524 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:06:44.020084 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.254:44749
I20260615 08:06:44.032963 10252 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.254:44749 every 8 connection(s)
I20260615 08:06:44.033073 10253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:06:44.034042 10253 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5299d591cd894378b078b8ce3439e910: Bootstrap starting.
I20260615 08:06:44.034340 10253 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5299d591cd894378b078b8ce3439e910: Neither blocks nor log segments found. Creating new log.
I20260615 08:06:44.034865 10253 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5299d591cd894378b078b8ce3439e910: No bootstrap required, opened a new log
I20260615 08:06:44.034996 10253 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5299d591cd894378b078b8ce3439e910 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5299d591cd894378b078b8ce3439e910" member_type: VOTER }
I20260615 08:06:44.035054 10253 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5299d591cd894378b078b8ce3439e910 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:06:44.035069 10253 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5299d591cd894378b078b8ce3439e910 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5299d591cd894378b078b8ce3439e910, State: Initialized, Role: FOLLOWER
I20260615 08:06:44.035144 10253 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5299d591cd894378b078b8ce3439e910 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5299d591cd894378b078b8ce3439e910" member_type: VOTER }
I20260615 08:06:44.035182 10253 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5299d591cd894378b078b8ce3439e910 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260615 08:06:44.035200 10253 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5299d591cd894378b078b8ce3439e910 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260615 08:06:44.035224 10253 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5299d591cd894378b078b8ce3439e910 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:06:44.035705 10253 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5299d591cd894378b078b8ce3439e910 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5299d591cd894378b078b8ce3439e910" member_type: VOTER }
I20260615 08:06:44.035758 10253 leader_election.cc:304] T 00000000000000000000000000000000 P 5299d591cd894378b078b8ce3439e910 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5299d591cd894378b078b8ce3439e910; no voters:
I20260615 08:06:44.035897 10253 leader_election.cc:290] T 00000000000000000000000000000000 P 5299d591cd894378b078b8ce3439e910 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260615 08:06:44.035976 10256 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5299d591cd894378b078b8ce3439e910 [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:06:44.036082 10253 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5299d591cd894378b078b8ce3439e910 [sys.catalog]: configured and running, proceeding with master startup.
I20260615 08:06:44.036121 10256 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5299d591cd894378b078b8ce3439e910 [term 1 LEADER]: Becoming Leader. State: Replica: 5299d591cd894378b078b8ce3439e910, State: Running, Role: LEADER
I20260615 08:06:44.036199 10256 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5299d591cd894378b078b8ce3439e910 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5299d591cd894378b078b8ce3439e910" member_type: VOTER }
I20260615 08:06:44.036404 10258 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5299d591cd894378b078b8ce3439e910 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5299d591cd894378b078b8ce3439e910. Latest consensus state: current_term: 1 leader_uuid: "5299d591cd894378b078b8ce3439e910" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5299d591cd894378b078b8ce3439e910" member_type: VOTER } }
I20260615 08:06:44.036473 10258 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5299d591cd894378b078b8ce3439e910 [sys.catalog]: This master's current role is: LEADER
I20260615 08:06:44.036758 10261 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260615 08:06:44.036757 10257 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5299d591cd894378b078b8ce3439e910 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5299d591cd894378b078b8ce3439e910" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5299d591cd894378b078b8ce3439e910" member_type: VOTER } }
I20260615 08:06:44.036880 10257 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5299d591cd894378b078b8ce3439e910 [sys.catalog]: This master's current role is: LEADER
I20260615 08:06:44.036929 10261 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260615 08:06:44.037515 4267 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260615 08:06:44.037521 10261 catalog_manager.cc:1382] Generated new cluster ID: f2325cf3aba24a6482a23bb89ce91a21
I20260615 08:06:44.037590 10261 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260615 08:06:44.059015 10261 catalog_manager.cc:1405] Generated new certificate authority record
I20260615 08:06:44.059404 10261 catalog_manager.cc:1539] Loading token signing keys...
I20260615 08:06:44.066425 10261 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 5299d591cd894378b078b8ce3439e910: Generated new TSK 0
I20260615 08:06:44.066494 10261 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260615 08:06:44.069234 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:06:44.070341 10274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:44.070444 10275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:44.070537 10277 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:44.070562 4267 server_base.cc:1061] running on GCE node
I20260615 08:06:44.070747 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:06:44.070782 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:06:44.070794 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510804070795 us; error 0 us; skew 500 ppm
I20260615 08:06:44.071357 4267 webserver.cc:533] Webserver started at http://127.4.42.193:44849/ using document root <none> and password file <none>
I20260615 08:06:44.071465 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:06:44.071511 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:06:44.071558 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:06:44.071784 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1781510637089012-4267-0/minicluster-data/ts-0-root/instance:
uuid: "a54ef98fcf954f2c9cbfc0c2b95ef67f"
format_stamp: "Formatted at 2026-06-15 08:06:44 on dist-test-slave-37n8"
I20260615 08:06:44.072700 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260615 08:06:44.073130 10282 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:44.073271 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:44.073308 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1781510637089012-4267-0/minicluster-data/ts-0-root
uuid: "a54ef98fcf954f2c9cbfc0c2b95ef67f"
format_stamp: "Formatted at 2026-06-15 08:06:44 on dist-test-slave-37n8"
I20260615 08:06:44.073333 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1781510637089012-4267-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1781510637089012-4267-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1781510637089012-4267-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:06:44.082882 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:06:44.083056 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:06:44.083190 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:06:44.083375 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:06:44.083400 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:44.083444 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:06:44.083469 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:44.086350 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.193:41591
I20260615 08:06:44.086390 10345 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.193:41591 every 8 connection(s)
I20260615 08:06:44.086709 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:06:44.087888 10353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:44.087913 10351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:44.088078 4267 server_base.cc:1061] running on GCE node
W20260615 08:06:44.088757 10350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:44.088937 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:06:44.088987 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:06:44.089010 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510804089009 us; error 0 us; skew 500 ppm
I20260615 08:06:44.089649 4267 webserver.cc:533] Webserver started at http://127.4.42.194:34771/ using document root <none> and password file <none>
I20260615 08:06:44.089749 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:06:44.089810 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:06:44.089854 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:06:44.090111 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1781510637089012-4267-0/minicluster-data/ts-1-root/instance:
uuid: "779c31a8a72448089da3e380ad5ce6e2"
format_stamp: "Formatted at 2026-06-15 08:06:44 on dist-test-slave-37n8"
I20260615 08:06:44.091028 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:06:44.091512 10358 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:44.091673 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:44.091745 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1781510637089012-4267-0/minicluster-data/ts-1-root
uuid: "779c31a8a72448089da3e380ad5ce6e2"
format_stamp: "Formatted at 2026-06-15 08:06:44 on dist-test-slave-37n8"
I20260615 08:06:44.091807 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1781510637089012-4267-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1781510637089012-4267-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1781510637089012-4267-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:06:44.093147 10346 heartbeater.cc:344] Connected to a master server at 127.4.42.254:44749
I20260615 08:06:44.093196 10346 heartbeater.cc:461] Registering TS with master...
I20260615 08:06:44.093307 10346 heartbeater.cc:507] Master 127.4.42.254:44749 requested a full tablet report, sending...
I20260615 08:06:44.093577 10217 ts_manager.cc:194] Registered new tserver with Master: a54ef98fcf954f2c9cbfc0c2b95ef67f (127.4.42.193:41591)
I20260615 08:06:44.094374 10217 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39774
I20260615 08:06:44.112373 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:06:44.112511 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:06:44.112607 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:06:44.112802 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:06:44.112830 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:44.112849 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:06:44.112891 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:44.115927 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.194:39973
I20260615 08:06:44.115983 10421 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.194:39973 every 8 connection(s)
I20260615 08:06:44.116317 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:06:44.117431 10426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:44.117558 4267 server_base.cc:1061] running on GCE node
W20260615 08:06:44.117590 10428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:44.117681 10425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:44.117805 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:06:44.117863 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:06:44.117887 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510804117887 us; error 0 us; skew 500 ppm
I20260615 08:06:44.118396 4267 webserver.cc:533] Webserver started at http://127.4.42.195:36667/ using document root <none> and password file <none>
I20260615 08:06:44.118512 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:06:44.118578 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:06:44.118628 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:06:44.118907 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1781510637089012-4267-0/minicluster-data/ts-2-root/instance:
uuid: "6e98287c6ce1495a8fb6ca1d33c4eb9f"
format_stamp: "Formatted at 2026-06-15 08:06:44 on dist-test-slave-37n8"
I20260615 08:06:44.119421 10422 heartbeater.cc:344] Connected to a master server at 127.4.42.254:44749
I20260615 08:06:44.119472 10422 heartbeater.cc:461] Registering TS with master...
I20260615 08:06:44.119550 10422 heartbeater.cc:507] Master 127.4.42.254:44749 requested a full tablet report, sending...
I20260615 08:06:44.119817 10217 ts_manager.cc:194] Registered new tserver with Master: 779c31a8a72448089da3e380ad5ce6e2 (127.4.42.194:39973)
I20260615 08:06:44.119896 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:06:44.120142 10217 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39790
I20260615 08:06:44.120388 10433 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:44.120528 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:44.120591 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1781510637089012-4267-0/minicluster-data/ts-2-root
uuid: "6e98287c6ce1495a8fb6ca1d33c4eb9f"
format_stamp: "Formatted at 2026-06-15 08:06:44 on dist-test-slave-37n8"
I20260615 08:06:44.120635 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1781510637089012-4267-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1781510637089012-4267-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientAbortSequence.1781510637089012-4267-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:06:44.129799 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:06:44.130012 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:06:44.130165 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:06:44.130353 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:06:44.130398 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:44.130435 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:06:44.130462 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:44.133486 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.195:41697
I20260615 08:06:44.133536 10496 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.195:41697 every 8 connection(s)
I20260615 08:06:44.136174 10497 heartbeater.cc:344] Connected to a master server at 127.4.42.254:44749
I20260615 08:06:44.136241 10497 heartbeater.cc:461] Registering TS with master...
I20260615 08:06:44.136308 10497 heartbeater.cc:507] Master 127.4.42.254:44749 requested a full tablet report, sending...
I20260615 08:06:44.136495 10217 ts_manager.cc:194] Registered new tserver with Master: 6e98287c6ce1495a8fb6ca1d33c4eb9f (127.4.42.195:41697)
I20260615 08:06:44.136859 10217 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39794
I20260615 08:06:44.137054 4267 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003356596s
I20260615 08:06:44.141930 10217 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39802:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260615 08:06:44.142047 10217 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260615 08:06:44.146639 10386 tablet_service.cc:1511] Processing CreateTablet for tablet b93242baec5a4d8494ccd3c28b4a9c0a (DEFAULT_TABLE table=test-workload [id=9580b69cc2e64a54a028e73f7f7e3b8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:06:44.146775 10386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b93242baec5a4d8494ccd3c28b4a9c0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:06:44.148110 10310 tablet_service.cc:1511] Processing CreateTablet for tablet b93242baec5a4d8494ccd3c28b4a9c0a (DEFAULT_TABLE table=test-workload [id=9580b69cc2e64a54a028e73f7f7e3b8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:06:44.148236 10310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b93242baec5a4d8494ccd3c28b4a9c0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:06:44.148254 10512 tablet_bootstrap.cc:492] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2: Bootstrap starting.
I20260615 08:06:44.148787 10512 tablet_bootstrap.cc:654] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2: Neither blocks nor log segments found. Creating new log.
I20260615 08:06:44.148939 10461 tablet_service.cc:1511] Processing CreateTablet for tablet b93242baec5a4d8494ccd3c28b4a9c0a (DEFAULT_TABLE table=test-workload [id=9580b69cc2e64a54a028e73f7f7e3b8c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:06:44.149034 10461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b93242baec5a4d8494ccd3c28b4a9c0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:06:44.149477 10514 tablet_bootstrap.cc:492] T b93242baec5a4d8494ccd3c28b4a9c0a P a54ef98fcf954f2c9cbfc0c2b95ef67f: Bootstrap starting.
I20260615 08:06:44.149883 10512 tablet_bootstrap.cc:492] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2: No bootstrap required, opened a new log
I20260615 08:06:44.149943 10512 ts_tablet_manager.cc:1403] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260615 08:06:44.149951 10514 tablet_bootstrap.cc:654] T b93242baec5a4d8494ccd3c28b4a9c0a P a54ef98fcf954f2c9cbfc0c2b95ef67f: Neither blocks nor log segments found. Creating new log.
I20260615 08:06:44.150159 10512 raft_consensus.cc:359] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "779c31a8a72448089da3e380ad5ce6e2" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39973 } } peers { permanent_uuid: "a54ef98fcf954f2c9cbfc0c2b95ef67f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41591 } } peers { permanent_uuid: "6e98287c6ce1495a8fb6ca1d33c4eb9f" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41697 } }
I20260615 08:06:44.150241 10512 raft_consensus.cc:385] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:06:44.150265 10512 raft_consensus.cc:740] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 779c31a8a72448089da3e380ad5ce6e2, State: Initialized, Role: FOLLOWER
I20260615 08:06:44.150339 10512 consensus_queue.cc:260] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "779c31a8a72448089da3e380ad5ce6e2" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39973 } } peers { permanent_uuid: "a54ef98fcf954f2c9cbfc0c2b95ef67f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41591 } } peers { permanent_uuid: "6e98287c6ce1495a8fb6ca1d33c4eb9f" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41697 } }
I20260615 08:06:44.150538 10515 tablet_bootstrap.cc:492] T b93242baec5a4d8494ccd3c28b4a9c0a P 6e98287c6ce1495a8fb6ca1d33c4eb9f: Bootstrap starting.
I20260615 08:06:44.150622 10422 heartbeater.cc:499] Master 127.4.42.254:44749 was elected leader, sending a full tablet report...
I20260615 08:06:44.150651 10514 tablet_bootstrap.cc:492] T b93242baec5a4d8494ccd3c28b4a9c0a P a54ef98fcf954f2c9cbfc0c2b95ef67f: No bootstrap required, opened a new log
I20260615 08:06:44.150697 10514 ts_tablet_manager.cc:1403] T b93242baec5a4d8494ccd3c28b4a9c0a P a54ef98fcf954f2c9cbfc0c2b95ef67f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:06:44.150722 10512 ts_tablet_manager.cc:1434] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260615 08:06:44.150844 10514 raft_consensus.cc:359] T b93242baec5a4d8494ccd3c28b4a9c0a P a54ef98fcf954f2c9cbfc0c2b95ef67f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "779c31a8a72448089da3e380ad5ce6e2" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39973 } } peers { permanent_uuid: "a54ef98fcf954f2c9cbfc0c2b95ef67f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41591 } } peers { permanent_uuid: "6e98287c6ce1495a8fb6ca1d33c4eb9f" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41697 } }
I20260615 08:06:44.150904 10514 raft_consensus.cc:385] T b93242baec5a4d8494ccd3c28b4a9c0a P a54ef98fcf954f2c9cbfc0c2b95ef67f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:06:44.150918 10514 raft_consensus.cc:740] T b93242baec5a4d8494ccd3c28b4a9c0a P a54ef98fcf954f2c9cbfc0c2b95ef67f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a54ef98fcf954f2c9cbfc0c2b95ef67f, State: Initialized, Role: FOLLOWER
I20260615 08:06:44.150978 10514 consensus_queue.cc:260] T b93242baec5a4d8494ccd3c28b4a9c0a P a54ef98fcf954f2c9cbfc0c2b95ef67f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "779c31a8a72448089da3e380ad5ce6e2" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39973 } } peers { permanent_uuid: "a54ef98fcf954f2c9cbfc0c2b95ef67f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41591 } } peers { permanent_uuid: "6e98287c6ce1495a8fb6ca1d33c4eb9f" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41697 } }
I20260615 08:06:44.151165 10514 ts_tablet_manager.cc:1434] T b93242baec5a4d8494ccd3c28b4a9c0a P a54ef98fcf954f2c9cbfc0c2b95ef67f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260615 08:06:44.151189 10346 heartbeater.cc:499] Master 127.4.42.254:44749 was elected leader, sending a full tablet report...
I20260615 08:06:44.151495 10515 tablet_bootstrap.cc:654] T b93242baec5a4d8494ccd3c28b4a9c0a P 6e98287c6ce1495a8fb6ca1d33c4eb9f: Neither blocks nor log segments found. Creating new log.
I20260615 08:06:44.152087 10515 tablet_bootstrap.cc:492] T b93242baec5a4d8494ccd3c28b4a9c0a P 6e98287c6ce1495a8fb6ca1d33c4eb9f: No bootstrap required, opened a new log
I20260615 08:06:44.152150 10515 ts_tablet_manager.cc:1403] T b93242baec5a4d8494ccd3c28b4a9c0a P 6e98287c6ce1495a8fb6ca1d33c4eb9f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260615 08:06:44.152295 10515 raft_consensus.cc:359] T b93242baec5a4d8494ccd3c28b4a9c0a P 6e98287c6ce1495a8fb6ca1d33c4eb9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "779c31a8a72448089da3e380ad5ce6e2" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39973 } } peers { permanent_uuid: "a54ef98fcf954f2c9cbfc0c2b95ef67f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41591 } } peers { permanent_uuid: "6e98287c6ce1495a8fb6ca1d33c4eb9f" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41697 } }
I20260615 08:06:44.152360 10515 raft_consensus.cc:385] T b93242baec5a4d8494ccd3c28b4a9c0a P 6e98287c6ce1495a8fb6ca1d33c4eb9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:06:44.152392 10515 raft_consensus.cc:740] T b93242baec5a4d8494ccd3c28b4a9c0a P 6e98287c6ce1495a8fb6ca1d33c4eb9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e98287c6ce1495a8fb6ca1d33c4eb9f, State: Initialized, Role: FOLLOWER
I20260615 08:06:44.152447 10515 consensus_queue.cc:260] T b93242baec5a4d8494ccd3c28b4a9c0a P 6e98287c6ce1495a8fb6ca1d33c4eb9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "779c31a8a72448089da3e380ad5ce6e2" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39973 } } peers { permanent_uuid: "a54ef98fcf954f2c9cbfc0c2b95ef67f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41591 } } peers { permanent_uuid: "6e98287c6ce1495a8fb6ca1d33c4eb9f" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41697 } }
I20260615 08:06:44.152603 10515 ts_tablet_manager.cc:1434] T b93242baec5a4d8494ccd3c28b4a9c0a P 6e98287c6ce1495a8fb6ca1d33c4eb9f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260615 08:06:44.152628 10497 heartbeater.cc:499] Master 127.4.42.254:44749 was elected leader, sending a full tablet report...
I20260615 08:06:44.168463 10517 raft_consensus.cc:493] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260615 08:06:44.168514 10517 raft_consensus.cc:515] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "779c31a8a72448089da3e380ad5ce6e2" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39973 } } peers { permanent_uuid: "a54ef98fcf954f2c9cbfc0c2b95ef67f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41591 } } peers { permanent_uuid: "6e98287c6ce1495a8fb6ca1d33c4eb9f" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41697 } }
I20260615 08:06:44.168679 10517 leader_election.cc:290] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a54ef98fcf954f2c9cbfc0c2b95ef67f (127.4.42.193:41591), 6e98287c6ce1495a8fb6ca1d33c4eb9f (127.4.42.195:41697)
I20260615 08:06:44.171180 10471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93242baec5a4d8494ccd3c28b4a9c0a" candidate_uuid: "779c31a8a72448089da3e380ad5ce6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e98287c6ce1495a8fb6ca1d33c4eb9f" is_pre_election: true
I20260615 08:06:44.171262 10471 raft_consensus.cc:2468] T b93242baec5a4d8494ccd3c28b4a9c0a P 6e98287c6ce1495a8fb6ca1d33c4eb9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 779c31a8a72448089da3e380ad5ce6e2 in term 0.
I20260615 08:06:44.171181 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93242baec5a4d8494ccd3c28b4a9c0a" candidate_uuid: "779c31a8a72448089da3e380ad5ce6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54ef98fcf954f2c9cbfc0c2b95ef67f" is_pre_election: true
I20260615 08:06:44.171298 10320 raft_consensus.cc:2468] T b93242baec5a4d8494ccd3c28b4a9c0a P a54ef98fcf954f2c9cbfc0c2b95ef67f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 779c31a8a72448089da3e380ad5ce6e2 in term 0.
I20260615 08:06:44.171475 10362 leader_election.cc:304] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 779c31a8a72448089da3e380ad5ce6e2, a54ef98fcf954f2c9cbfc0c2b95ef67f; no voters:
I20260615 08:06:44.171612 10517 raft_consensus.cc:2804] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260615 08:06:44.171653 10517 raft_consensus.cc:493] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:06:44.171669 10517 raft_consensus.cc:3060] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:06:44.172147 10517 raft_consensus.cc:515] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "779c31a8a72448089da3e380ad5ce6e2" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39973 } } peers { permanent_uuid: "a54ef98fcf954f2c9cbfc0c2b95ef67f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41591 } } peers { permanent_uuid: "6e98287c6ce1495a8fb6ca1d33c4eb9f" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41697 } }
I20260615 08:06:44.172278 10517 leader_election.cc:290] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2 [CANDIDATE]: Term 1 election: Requested vote from peers a54ef98fcf954f2c9cbfc0c2b95ef67f (127.4.42.193:41591), 6e98287c6ce1495a8fb6ca1d33c4eb9f (127.4.42.195:41697)
I20260615 08:06:44.172389 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93242baec5a4d8494ccd3c28b4a9c0a" candidate_uuid: "779c31a8a72448089da3e380ad5ce6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a54ef98fcf954f2c9cbfc0c2b95ef67f"
I20260615 08:06:44.172407 10471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93242baec5a4d8494ccd3c28b4a9c0a" candidate_uuid: "779c31a8a72448089da3e380ad5ce6e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e98287c6ce1495a8fb6ca1d33c4eb9f"
I20260615 08:06:44.172458 10320 raft_consensus.cc:3060] T b93242baec5a4d8494ccd3c28b4a9c0a P a54ef98fcf954f2c9cbfc0c2b95ef67f [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:06:44.172466 10471 raft_consensus.cc:3060] T b93242baec5a4d8494ccd3c28b4a9c0a P 6e98287c6ce1495a8fb6ca1d33c4eb9f [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:06:44.173163 10471 raft_consensus.cc:2468] T b93242baec5a4d8494ccd3c28b4a9c0a P 6e98287c6ce1495a8fb6ca1d33c4eb9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 779c31a8a72448089da3e380ad5ce6e2 in term 1.
I20260615 08:06:44.173163 10320 raft_consensus.cc:2468] T b93242baec5a4d8494ccd3c28b4a9c0a P a54ef98fcf954f2c9cbfc0c2b95ef67f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 779c31a8a72448089da3e380ad5ce6e2 in term 1.
I20260615 08:06:44.173368 10361 leader_election.cc:304] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e98287c6ce1495a8fb6ca1d33c4eb9f, 779c31a8a72448089da3e380ad5ce6e2; no voters:
I20260615 08:06:44.173473 10517 raft_consensus.cc:2804] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:06:44.173583 10517 raft_consensus.cc:697] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2 [term 1 LEADER]: Becoming Leader. State: Replica: 779c31a8a72448089da3e380ad5ce6e2, State: Running, Role: LEADER
I20260615 08:06:44.173629 10517 consensus_queue.cc:237] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "779c31a8a72448089da3e380ad5ce6e2" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39973 } } peers { permanent_uuid: "a54ef98fcf954f2c9cbfc0c2b95ef67f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41591 } } peers { permanent_uuid: "6e98287c6ce1495a8fb6ca1d33c4eb9f" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41697 } }
I20260615 08:06:44.174034 10217 catalog_manager.cc:5696] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 779c31a8a72448089da3e380ad5ce6e2 (127.4.42.194). New cstate: current_term: 1 leader_uuid: "779c31a8a72448089da3e380ad5ce6e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "779c31a8a72448089da3e380ad5ce6e2" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a54ef98fcf954f2c9cbfc0c2b95ef67f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41591 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e98287c6ce1495a8fb6ca1d33c4eb9f" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41697 } health_report { overall_health: UNKNOWN } } }
I20260615 08:06:44.187340 10320 raft_consensus.cc:1275] T b93242baec5a4d8494ccd3c28b4a9c0a P a54ef98fcf954f2c9cbfc0c2b95ef67f [term 1 FOLLOWER]: Refusing update from remote peer 779c31a8a72448089da3e380ad5ce6e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:06:44.187340 10471 raft_consensus.cc:1275] T b93242baec5a4d8494ccd3c28b4a9c0a P 6e98287c6ce1495a8fb6ca1d33c4eb9f [term 1 FOLLOWER]: Refusing update from remote peer 779c31a8a72448089da3e380ad5ce6e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:06:44.187584 10517 consensus_queue.cc:1048] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a54ef98fcf954f2c9cbfc0c2b95ef67f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:06:44.187664 10522 consensus_queue.cc:1048] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e98287c6ce1495a8fb6ca1d33c4eb9f" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:06:54.727936 10547 raft_consensus.cc:993] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2: : Instructing follower a54ef98fcf954f2c9cbfc0c2b95ef67f to start an election
I20260615 08:06:54.728014 10547 raft_consensus.cc:1081] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2 [term 1 LEADER]: Signalling peer a54ef98fcf954f2c9cbfc0c2b95ef67f to start an election
I20260615 08:06:54.728259 10320 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b93242baec5a4d8494ccd3c28b4a9c0a"
dest_uuid: "a54ef98fcf954f2c9cbfc0c2b95ef67f"
from {username='slave'} at 127.0.0.1:58628
I20260615 08:06:54.728368 10320 raft_consensus.cc:493] T b93242baec5a4d8494ccd3c28b4a9c0a P a54ef98fcf954f2c9cbfc0c2b95ef67f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260615 08:06:54.728404 10320 raft_consensus.cc:3060] T b93242baec5a4d8494ccd3c28b4a9c0a P a54ef98fcf954f2c9cbfc0c2b95ef67f [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:06:54.729061 10320 raft_consensus.cc:515] T b93242baec5a4d8494ccd3c28b4a9c0a P a54ef98fcf954f2c9cbfc0c2b95ef67f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "779c31a8a72448089da3e380ad5ce6e2" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39973 } } peers { permanent_uuid: "a54ef98fcf954f2c9cbfc0c2b95ef67f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41591 } } peers { permanent_uuid: "6e98287c6ce1495a8fb6ca1d33c4eb9f" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41697 } }
I20260615 08:06:54.729274 10320 leader_election.cc:290] T b93242baec5a4d8494ccd3c28b4a9c0a P a54ef98fcf954f2c9cbfc0c2b95ef67f [CANDIDATE]: Term 2 election: Requested vote from peers 779c31a8a72448089da3e380ad5ce6e2 (127.4.42.194:39973), 6e98287c6ce1495a8fb6ca1d33c4eb9f (127.4.42.195:41697)
I20260615 08:06:54.732081 10470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93242baec5a4d8494ccd3c28b4a9c0a" candidate_uuid: "a54ef98fcf954f2c9cbfc0c2b95ef67f" candidate_term: 2 candidate_status { last_received { term: 1 index: 13866 } } ignore_live_leader: true dest_uuid: "6e98287c6ce1495a8fb6ca1d33c4eb9f"
I20260615 08:06:54.732082 10396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b93242baec5a4d8494ccd3c28b4a9c0a" candidate_uuid: "a54ef98fcf954f2c9cbfc0c2b95ef67f" candidate_term: 2 candidate_status { last_received { term: 1 index: 13866 } } ignore_live_leader: true dest_uuid: "779c31a8a72448089da3e380ad5ce6e2"
I20260615 08:06:54.732190 10470 raft_consensus.cc:3060] T b93242baec5a4d8494ccd3c28b4a9c0a P 6e98287c6ce1495a8fb6ca1d33c4eb9f [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:06:54.732196 10396 raft_consensus.cc:3055] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2 [term 1 LEADER]: Stepping down as leader of term 1
I20260615 08:06:54.732259 10396 raft_consensus.cc:740] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 779c31a8a72448089da3e380ad5ce6e2, State: Running, Role: LEADER
I20260615 08:06:54.732326 10396 consensus_queue.cc:260] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13866, Committed index: 13866, Last appended: 1.13866, Last appended by leader: 13866, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "779c31a8a72448089da3e380ad5ce6e2" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39973 } } peers { permanent_uuid: "a54ef98fcf954f2c9cbfc0c2b95ef67f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41591 } } peers { permanent_uuid: "6e98287c6ce1495a8fb6ca1d33c4eb9f" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41697 } }
I20260615 08:06:54.732424 10396 raft_consensus.cc:3060] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2 [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:06:54.732914 10470 raft_consensus.cc:2468] T b93242baec5a4d8494ccd3c28b4a9c0a P 6e98287c6ce1495a8fb6ca1d33c4eb9f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54ef98fcf954f2c9cbfc0c2b95ef67f in term 2.
I20260615 08:06:54.733063 10396 raft_consensus.cc:2468] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a54ef98fcf954f2c9cbfc0c2b95ef67f in term 2.
I20260615 08:06:54.733173 10285 leader_election.cc:304] T b93242baec5a4d8494ccd3c28b4a9c0a P a54ef98fcf954f2c9cbfc0c2b95ef67f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e98287c6ce1495a8fb6ca1d33c4eb9f, a54ef98fcf954f2c9cbfc0c2b95ef67f; no voters:
I20260615 08:06:54.733371 10576 raft_consensus.cc:2804] T b93242baec5a4d8494ccd3c28b4a9c0a P a54ef98fcf954f2c9cbfc0c2b95ef67f [term 2 FOLLOWER]: Leader election won for term 2
I20260615 08:06:54.733512 10576 raft_consensus.cc:697] T b93242baec5a4d8494ccd3c28b4a9c0a P a54ef98fcf954f2c9cbfc0c2b95ef67f [term 2 LEADER]: Becoming Leader. State: Replica: a54ef98fcf954f2c9cbfc0c2b95ef67f, State: Running, Role: LEADER
I20260615 08:06:54.733587 10576 consensus_queue.cc:237] T b93242baec5a4d8494ccd3c28b4a9c0a P a54ef98fcf954f2c9cbfc0c2b95ef67f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13866, Committed index: 13866, Last appended: 1.13866, Last appended by leader: 13866, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "779c31a8a72448089da3e380ad5ce6e2" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39973 } } peers { permanent_uuid: "a54ef98fcf954f2c9cbfc0c2b95ef67f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41591 } } peers { permanent_uuid: "6e98287c6ce1495a8fb6ca1d33c4eb9f" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41697 } }
I20260615 08:06:54.734083 10211 catalog_manager.cc:5696] T b93242baec5a4d8494ccd3c28b4a9c0a P a54ef98fcf954f2c9cbfc0c2b95ef67f reported cstate change: term changed from 1 to 2, leader changed from 779c31a8a72448089da3e380ad5ce6e2 (127.4.42.194) to a54ef98fcf954f2c9cbfc0c2b95ef67f (127.4.42.193). New cstate: current_term: 2 leader_uuid: "a54ef98fcf954f2c9cbfc0c2b95ef67f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "779c31a8a72448089da3e380ad5ce6e2" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a54ef98fcf954f2c9cbfc0c2b95ef67f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41591 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e98287c6ce1495a8fb6ca1d33c4eb9f" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41697 } health_report { overall_health: UNKNOWN } } }
I20260615 08:06:54.743956 10470 raft_consensus.cc:1275] T b93242baec5a4d8494ccd3c28b4a9c0a P 6e98287c6ce1495a8fb6ca1d33c4eb9f [term 2 FOLLOWER]: Refusing update from remote peer a54ef98fcf954f2c9cbfc0c2b95ef67f: Log matching property violated. Preceding OpId in replica: term: 1 index: 13866. Preceding OpId from leader: term: 2 index: 13868. (index mismatch)
I20260615 08:06:54.743990 10396 raft_consensus.cc:1275] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2 [term 2 FOLLOWER]: Refusing update from remote peer a54ef98fcf954f2c9cbfc0c2b95ef67f: Log matching property violated. Preceding OpId in replica: term: 1 index: 13866. Preceding OpId from leader: term: 2 index: 13868. (index mismatch)
I20260615 08:06:54.744144 10576 consensus_queue.cc:1048] T b93242baec5a4d8494ccd3c28b4a9c0a P a54ef98fcf954f2c9cbfc0c2b95ef67f [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e98287c6ce1495a8fb6ca1d33c4eb9f" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 41697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13867, Last known committed idx: 13866, Time since last communication: 0.000s
I20260615 08:06:54.744244 10577 consensus_queue.cc:1048] T b93242baec5a4d8494ccd3c28b4a9c0a P a54ef98fcf954f2c9cbfc0c2b95ef67f [LEADER]: Connected to new peer: Peer: permanent_uuid: "779c31a8a72448089da3e380ad5ce6e2" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13867, Last known committed idx: 13866, Time since last communication: 0.000s
W20260615 08:06:54.752439 10590 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37818: Illegal state: Transaction metadata for transaction 0 already exists
W20260615 08:06:54.752846 10590 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37818: Illegal state: Transaction metadata for transaction 1 already exists
W20260615 08:06:54.753226 10590 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37818: Illegal state: Cannot begin committing transaction in state: INITIALIZING
W20260615 08:06:54.753643 10590 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37818: Illegal state: Cannot begin committing transaction in state: INITIALIZING
W20260615 08:06:54.754045 10590 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37818: Illegal state: Transaction metadata for transaction 0 already exists
W20260615 08:06:54.754428 10590 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37818: Illegal state: Transaction metadata for transaction 1 already exists
W20260615 08:06:54.754837 10590 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37818: Illegal state: Transaction metadata for transaction 0 already set
W20260615 08:06:54.755244 10590 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37818: Illegal state: Transaction metadata for transaction 1 already set
I20260615 08:06:54.755673 4267 tablet_server.cc:179] TabletServer@127.4.42.193:0 shutting down...
I20260615 08:06:54.758180 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:06:54.758287 4267 tablet_replica.cc:333] T b93242baec5a4d8494ccd3c28b4a9c0a P a54ef98fcf954f2c9cbfc0c2b95ef67f: stopping tablet replica
I20260615 08:06:54.758342 4267 raft_consensus.cc:2243] T b93242baec5a4d8494ccd3c28b4a9c0a P a54ef98fcf954f2c9cbfc0c2b95ef67f [term 2 LEADER]: Raft consensus shutting down.
I20260615 08:06:54.758394 4267 raft_consensus.cc:2272] T b93242baec5a4d8494ccd3c28b4a9c0a P a54ef98fcf954f2c9cbfc0c2b95ef67f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:06:54.772073 4267 tablet_server.cc:196] TabletServer@127.4.42.193:0 shutdown complete.
I20260615 08:06:54.772753 4267 tablet_server.cc:179] TabletServer@127.4.42.194:0 shutting down...
I20260615 08:06:54.775484 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:06:54.775607 4267 tablet_replica.cc:333] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2: stopping tablet replica
I20260615 08:06:54.775655 4267 raft_consensus.cc:2243] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260615 08:06:54.775691 4267 raft_consensus.cc:2272] T b93242baec5a4d8494ccd3c28b4a9c0a P 779c31a8a72448089da3e380ad5ce6e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:06:54.798062 4267 tablet_server.cc:196] TabletServer@127.4.42.194:0 shutdown complete.
I20260615 08:06:54.798883 4267 tablet_server.cc:179] TabletServer@127.4.42.195:0 shutting down...
I20260615 08:06:54.801199 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:06:54.801280 4267 tablet_replica.cc:333] T b93242baec5a4d8494ccd3c28b4a9c0a P 6e98287c6ce1495a8fb6ca1d33c4eb9f: stopping tablet replica
I20260615 08:06:54.801342 4267 raft_consensus.cc:2243] T b93242baec5a4d8494ccd3c28b4a9c0a P 6e98287c6ce1495a8fb6ca1d33c4eb9f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260615 08:06:54.801385 4267 raft_consensus.cc:2272] T b93242baec5a4d8494ccd3c28b4a9c0a P 6e98287c6ce1495a8fb6ca1d33c4eb9f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:06:54.814810 4267 tablet_server.cc:196] TabletServer@127.4.42.195:0 shutdown complete.
I20260615 08:06:54.815506 4267 master.cc:562] Master@127.4.42.254:44749 shutting down...
I20260615 08:06:54.817739 4267 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5299d591cd894378b078b8ce3439e910 [term 1 LEADER]: Raft consensus shutting down.
I20260615 08:06:54.817801 4267 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5299d591cd894378b078b8ce3439e910 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:06:54.817835 4267 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5299d591cd894378b078b8ce3439e910: stopping tablet replica
I20260615 08:06:54.829571 4267 master.cc:584] Master@127.4.42.254:44749 shutdown complete.
[ OK ] TxnParticipantITest.TestTxnSystemClientAbortSequence (10859 ms)
[ RUN ] TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun
I20260615 08:06:54.848102 4267 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.42.254:37809
I20260615 08:06:54.848287 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:06:54.849586 10600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:54.849643 4267 server_base.cc:1061] running on GCE node
W20260615 08:06:54.849685 10599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:54.849807 10602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:54.849972 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:06:54.850025 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:06:54.850049 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510814850048 us; error 0 us; skew 500 ppm
I20260615 08:06:54.850641 4267 webserver.cc:533] Webserver started at http://127.4.42.254:45649/ using document root <none> and password file <none>
I20260615 08:06:54.850734 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:06:54.850776 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:06:54.850819 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:06:54.851046 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/master-0-root/instance:
uuid: "4cf9d79254ee4c2a96441901f507db51"
format_stamp: "Formatted at 2026-06-15 08:06:54 on dist-test-slave-37n8"
I20260615 08:06:54.851876 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:06:54.852286 10607 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:54.852424 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:54.852478 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/master-0-root
uuid: "4cf9d79254ee4c2a96441901f507db51"
format_stamp: "Formatted at 2026-06-15 08:06:54 on dist-test-slave-37n8"
I20260615 08:06:54.852520 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:06:54.867029 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:06:54.867201 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:06:54.869469 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.254:37809
I20260615 08:06:54.878059 10659 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.254:37809 every 8 connection(s)
I20260615 08:06:54.880596 10660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:06:54.881589 10660 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cf9d79254ee4c2a96441901f507db51: Bootstrap starting.
I20260615 08:06:54.881893 10660 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4cf9d79254ee4c2a96441901f507db51: Neither blocks nor log segments found. Creating new log.
I20260615 08:06:54.882360 10660 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cf9d79254ee4c2a96441901f507db51: No bootstrap required, opened a new log
I20260615 08:06:54.882536 10660 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4cf9d79254ee4c2a96441901f507db51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cf9d79254ee4c2a96441901f507db51" member_type: VOTER }
I20260615 08:06:54.882608 10660 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4cf9d79254ee4c2a96441901f507db51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:06:54.882642 10660 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4cf9d79254ee4c2a96441901f507db51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cf9d79254ee4c2a96441901f507db51, State: Initialized, Role: FOLLOWER
I20260615 08:06:54.882704 10660 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4cf9d79254ee4c2a96441901f507db51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cf9d79254ee4c2a96441901f507db51" member_type: VOTER }
I20260615 08:06:54.882771 10660 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4cf9d79254ee4c2a96441901f507db51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260615 08:06:54.882800 10660 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4cf9d79254ee4c2a96441901f507db51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260615 08:06:54.882827 10660 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4cf9d79254ee4c2a96441901f507db51 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:06:54.883268 10660 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4cf9d79254ee4c2a96441901f507db51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cf9d79254ee4c2a96441901f507db51" member_type: VOTER }
I20260615 08:06:54.883342 10660 leader_election.cc:304] T 00000000000000000000000000000000 P 4cf9d79254ee4c2a96441901f507db51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4cf9d79254ee4c2a96441901f507db51; no voters:
I20260615 08:06:54.883450 10660 leader_election.cc:290] T 00000000000000000000000000000000 P 4cf9d79254ee4c2a96441901f507db51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260615 08:06:54.883486 10663 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4cf9d79254ee4c2a96441901f507db51 [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:06:54.883590 10660 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4cf9d79254ee4c2a96441901f507db51 [sys.catalog]: configured and running, proceeding with master startup.
I20260615 08:06:54.883628 10663 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4cf9d79254ee4c2a96441901f507db51 [term 1 LEADER]: Becoming Leader. State: Replica: 4cf9d79254ee4c2a96441901f507db51, State: Running, Role: LEADER
I20260615 08:06:54.883687 10663 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4cf9d79254ee4c2a96441901f507db51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cf9d79254ee4c2a96441901f507db51" member_type: VOTER }
I20260615 08:06:54.883929 10664 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cf9d79254ee4c2a96441901f507db51 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4cf9d79254ee4c2a96441901f507db51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cf9d79254ee4c2a96441901f507db51" member_type: VOTER } }
I20260615 08:06:54.883929 10665 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cf9d79254ee4c2a96441901f507db51 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4cf9d79254ee4c2a96441901f507db51. Latest consensus state: current_term: 1 leader_uuid: "4cf9d79254ee4c2a96441901f507db51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cf9d79254ee4c2a96441901f507db51" member_type: VOTER } }
I20260615 08:06:54.884066 10664 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cf9d79254ee4c2a96441901f507db51 [sys.catalog]: This master's current role is: LEADER
I20260615 08:06:54.884085 10665 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cf9d79254ee4c2a96441901f507db51 [sys.catalog]: This master's current role is: LEADER
I20260615 08:06:54.884286 10670 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260615 08:06:54.884440 10670 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260615 08:06:54.884915 4267 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260615 08:06:54.884987 10670 catalog_manager.cc:1382] Generated new cluster ID: edd5524ce61745bfa5f20658adfe0f06
I20260615 08:06:54.885030 10670 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260615 08:06:54.906148 10670 catalog_manager.cc:1405] Generated new certificate authority record
I20260615 08:06:54.906641 10670 catalog_manager.cc:1539] Loading token signing keys...
I20260615 08:06:54.911180 10670 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 4cf9d79254ee4c2a96441901f507db51: Generated new TSK 0
I20260615 08:06:54.911250 10670 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260615 08:06:54.916736 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:06:54.918071 10681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:54.918238 4267 server_base.cc:1061] running on GCE node
W20260615 08:06:54.918229 10684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:54.918231 10682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:54.918540 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:06:54.918584 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:06:54.918598 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510814918598 us; error 0 us; skew 500 ppm
I20260615 08:06:54.919139 4267 webserver.cc:533] Webserver started at http://127.4.42.193:35481/ using document root <none> and password file <none>
I20260615 08:06:54.919234 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:06:54.919278 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:06:54.919324 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:06:54.919637 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/ts-0-root/instance:
uuid: "3754064d4ed94dcf92ac79858dc3e576"
format_stamp: "Formatted at 2026-06-15 08:06:54 on dist-test-slave-37n8"
I20260615 08:06:54.920507 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:06:54.920958 10689 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:54.921077 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:54.921139 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/ts-0-root
uuid: "3754064d4ed94dcf92ac79858dc3e576"
format_stamp: "Formatted at 2026-06-15 08:06:54 on dist-test-slave-37n8"
I20260615 08:06:54.921180 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:06:54.933868 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:06:54.934067 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:06:54.934212 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:06:54.934406 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:06:54.934453 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:54.934481 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:06:54.934538 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:54.937323 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.193:46407
I20260615 08:06:54.937347 10752 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.193:46407 every 8 connection(s)
I20260615 08:06:54.937674 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:06:54.938697 10757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:54.938881 10758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:54.938954 10760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:54.939088 4267 server_base.cc:1061] running on GCE node
I20260615 08:06:54.939260 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:06:54.939303 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:06:54.939319 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510814939320 us; error 0 us; skew 500 ppm
I20260615 08:06:54.939982 4267 webserver.cc:533] Webserver started at http://127.4.42.194:34971/ using document root <none> and password file <none>
I20260615 08:06:54.940083 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:06:54.940131 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:06:54.940183 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:06:54.940485 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/ts-1-root/instance:
uuid: "a5a48efede7b48d29a3711b46cad90c1"
format_stamp: "Formatted at 2026-06-15 08:06:54 on dist-test-slave-37n8"
I20260615 08:06:54.941208 10753 heartbeater.cc:344] Connected to a master server at 127.4.42.254:37809
I20260615 08:06:54.941267 10753 heartbeater.cc:461] Registering TS with master...
I20260615 08:06:54.941370 10753 heartbeater.cc:507] Master 127.4.42.254:37809 requested a full tablet report, sending...
I20260615 08:06:54.941581 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:06:54.941608 10624 ts_manager.cc:194] Registered new tserver with Master: 3754064d4ed94dcf92ac79858dc3e576 (127.4.42.193:46407)
I20260615 08:06:54.942049 10765 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:54.942173 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:54.942257 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/ts-1-root
uuid: "a5a48efede7b48d29a3711b46cad90c1"
format_stamp: "Formatted at 2026-06-15 08:06:54 on dist-test-slave-37n8"
I20260615 08:06:54.942255 10624 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54488
I20260615 08:06:54.942319 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:06:54.953464 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:06:54.953660 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:06:54.953799 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:06:54.953976 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:06:54.954020 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:54.954056 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:06:54.954082 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:54.957160 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.194:41617
I20260615 08:06:54.957242 10828 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.194:41617 every 8 connection(s)
I20260615 08:06:54.957593 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:06:54.958561 10832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:54.958592 10833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:06:54.958669 10835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:06:54.958834 4267 server_base.cc:1061] running on GCE node
I20260615 08:06:54.958937 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:06:54.958971 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:06:54.958988 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510814958989 us; error 0 us; skew 500 ppm
I20260615 08:06:54.959522 4267 webserver.cc:533] Webserver started at http://127.4.42.195:46261/ using document root <none> and password file <none>
I20260615 08:06:54.959614 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:06:54.959656 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:06:54.959703 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:06:54.959966 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/ts-2-root/instance:
uuid: "6f26187d4901494bb1bf27abe7dfa541"
format_stamp: "Formatted at 2026-06-15 08:06:54 on dist-test-slave-37n8"
I20260615 08:06:54.960877 10829 heartbeater.cc:344] Connected to a master server at 127.4.42.254:37809
I20260615 08:06:54.960933 10829 heartbeater.cc:461] Registering TS with master...
I20260615 08:06:54.961040 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:06:54.961042 10829 heartbeater.cc:507] Master 127.4.42.254:37809 requested a full tablet report, sending...
I20260615 08:06:54.961285 10624 ts_manager.cc:194] Registered new tserver with Master: a5a48efede7b48d29a3711b46cad90c1 (127.4.42.194:41617)
I20260615 08:06:54.961529 10840 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:54.961620 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:54.961648 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/ts-2-root
uuid: "6f26187d4901494bb1bf27abe7dfa541"
format_stamp: "Formatted at 2026-06-15 08:06:54 on dist-test-slave-37n8"
I20260615 08:06:54.961681 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun.1781510637089012-4267-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:06:54.961709 10624 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54496
I20260615 08:06:54.982759 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:06:54.982925 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:06:54.983021 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:06:54.983222 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:06:54.983270 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:54.983307 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:06:54.983335 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:06:54.986624 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.195:45601
I20260615 08:06:54.986668 10903 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.195:45601 every 8 connection(s)
I20260615 08:06:54.989466 10904 heartbeater.cc:344] Connected to a master server at 127.4.42.254:37809
I20260615 08:06:54.989529 10904 heartbeater.cc:461] Registering TS with master...
I20260615 08:06:54.989641 10904 heartbeater.cc:507] Master 127.4.42.254:37809 requested a full tablet report, sending...
I20260615 08:06:54.989871 10624 ts_manager.cc:194] Registered new tserver with Master: 6f26187d4901494bb1bf27abe7dfa541 (127.4.42.195:45601)
I20260615 08:06:54.990087 4267 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003290892s
I20260615 08:06:54.990325 10624 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54504
I20260615 08:06:54.994526 10624 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54514:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260615 08:06:54.994657 10624 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260615 08:06:54.998726 10717 tablet_service.cc:1511] Processing CreateTablet for tablet 6475ad94b2b3438ca188be427adfa5a8 (DEFAULT_TABLE table=test-workload [id=780d2a6e97054d5f9ed21d1eac831dae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:06:54.998859 10717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6475ad94b2b3438ca188be427adfa5a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:06:54.999176 10793 tablet_service.cc:1511] Processing CreateTablet for tablet 6475ad94b2b3438ca188be427adfa5a8 (DEFAULT_TABLE table=test-workload [id=780d2a6e97054d5f9ed21d1eac831dae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:06:54.999269 10793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6475ad94b2b3438ca188be427adfa5a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:06:55.000375 10919 tablet_bootstrap.cc:492] T 6475ad94b2b3438ca188be427adfa5a8 P 3754064d4ed94dcf92ac79858dc3e576: Bootstrap starting.
I20260615 08:06:55.000617 10920 tablet_bootstrap.cc:492] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1: Bootstrap starting.
I20260615 08:06:55.000790 10868 tablet_service.cc:1511] Processing CreateTablet for tablet 6475ad94b2b3438ca188be427adfa5a8 (DEFAULT_TABLE table=test-workload [id=780d2a6e97054d5f9ed21d1eac831dae]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:06:55.000856 10919 tablet_bootstrap.cc:654] T 6475ad94b2b3438ca188be427adfa5a8 P 3754064d4ed94dcf92ac79858dc3e576: Neither blocks nor log segments found. Creating new log.
I20260615 08:06:55.000896 10868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6475ad94b2b3438ca188be427adfa5a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:06:55.001039 10920 tablet_bootstrap.cc:654] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1: Neither blocks nor log segments found. Creating new log.
I20260615 08:06:55.001433 10919 tablet_bootstrap.cc:492] T 6475ad94b2b3438ca188be427adfa5a8 P 3754064d4ed94dcf92ac79858dc3e576: No bootstrap required, opened a new log
I20260615 08:06:55.001495 10919 ts_tablet_manager.cc:1403] T 6475ad94b2b3438ca188be427adfa5a8 P 3754064d4ed94dcf92ac79858dc3e576: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:06:55.001601 10920 tablet_bootstrap.cc:492] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1: No bootstrap required, opened a new log
I20260615 08:06:55.001644 10920 ts_tablet_manager.cc:1403] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:06:55.001865 10920 raft_consensus.cc:359] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5a48efede7b48d29a3711b46cad90c1" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 41617 } } peers { permanent_uuid: "6f26187d4901494bb1bf27abe7dfa541" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 45601 } } peers { permanent_uuid: "3754064d4ed94dcf92ac79858dc3e576" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 46407 } }
I20260615 08:06:55.001865 10919 raft_consensus.cc:359] T 6475ad94b2b3438ca188be427adfa5a8 P 3754064d4ed94dcf92ac79858dc3e576 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5a48efede7b48d29a3711b46cad90c1" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 41617 } } peers { permanent_uuid: "6f26187d4901494bb1bf27abe7dfa541" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 45601 } } peers { permanent_uuid: "3754064d4ed94dcf92ac79858dc3e576" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 46407 } }
I20260615 08:06:55.001952 10920 raft_consensus.cc:385] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:06:55.001961 10919 raft_consensus.cc:385] T 6475ad94b2b3438ca188be427adfa5a8 P 3754064d4ed94dcf92ac79858dc3e576 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:06:55.001983 10920 raft_consensus.cc:740] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5a48efede7b48d29a3711b46cad90c1, State: Initialized, Role: FOLLOWER
I20260615 08:06:55.002007 10919 raft_consensus.cc:740] T 6475ad94b2b3438ca188be427adfa5a8 P 3754064d4ed94dcf92ac79858dc3e576 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3754064d4ed94dcf92ac79858dc3e576, State: Initialized, Role: FOLLOWER
I20260615 08:06:55.002035 10920 consensus_queue.cc:260] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5a48efede7b48d29a3711b46cad90c1" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 41617 } } peers { permanent_uuid: "6f26187d4901494bb1bf27abe7dfa541" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 45601 } } peers { permanent_uuid: "3754064d4ed94dcf92ac79858dc3e576" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 46407 } }
I20260615 08:06:55.002064 10919 consensus_queue.cc:260] T 6475ad94b2b3438ca188be427adfa5a8 P 3754064d4ed94dcf92ac79858dc3e576 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5a48efede7b48d29a3711b46cad90c1" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 41617 } } peers { permanent_uuid: "6f26187d4901494bb1bf27abe7dfa541" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 45601 } } peers { permanent_uuid: "3754064d4ed94dcf92ac79858dc3e576" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 46407 } }
I20260615 08:06:55.002189 10920 ts_tablet_manager.cc:1434] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260615 08:06:55.002210 10919 ts_tablet_manager.cc:1434] T 6475ad94b2b3438ca188be427adfa5a8 P 3754064d4ed94dcf92ac79858dc3e576: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:06:55.002301 10829 heartbeater.cc:499] Master 127.4.42.254:37809 was elected leader, sending a full tablet report...
I20260615 08:06:55.002418 10753 heartbeater.cc:499] Master 127.4.42.254:37809 was elected leader, sending a full tablet report...
I20260615 08:06:55.002301 10923 tablet_bootstrap.cc:492] T 6475ad94b2b3438ca188be427adfa5a8 P 6f26187d4901494bb1bf27abe7dfa541: Bootstrap starting.
I20260615 08:06:55.002926 10923 tablet_bootstrap.cc:654] T 6475ad94b2b3438ca188be427adfa5a8 P 6f26187d4901494bb1bf27abe7dfa541: Neither blocks nor log segments found. Creating new log.
I20260615 08:06:55.003450 10923 tablet_bootstrap.cc:492] T 6475ad94b2b3438ca188be427adfa5a8 P 6f26187d4901494bb1bf27abe7dfa541: No bootstrap required, opened a new log
I20260615 08:06:55.003485 10923 ts_tablet_manager.cc:1403] T 6475ad94b2b3438ca188be427adfa5a8 P 6f26187d4901494bb1bf27abe7dfa541: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:06:55.003638 10923 raft_consensus.cc:359] T 6475ad94b2b3438ca188be427adfa5a8 P 6f26187d4901494bb1bf27abe7dfa541 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5a48efede7b48d29a3711b46cad90c1" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 41617 } } peers { permanent_uuid: "6f26187d4901494bb1bf27abe7dfa541" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 45601 } } peers { permanent_uuid: "3754064d4ed94dcf92ac79858dc3e576" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 46407 } }
I20260615 08:06:55.003682 10923 raft_consensus.cc:385] T 6475ad94b2b3438ca188be427adfa5a8 P 6f26187d4901494bb1bf27abe7dfa541 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:06:55.003723 10923 raft_consensus.cc:740] T 6475ad94b2b3438ca188be427adfa5a8 P 6f26187d4901494bb1bf27abe7dfa541 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f26187d4901494bb1bf27abe7dfa541, State: Initialized, Role: FOLLOWER
I20260615 08:06:55.003790 10923 consensus_queue.cc:260] T 6475ad94b2b3438ca188be427adfa5a8 P 6f26187d4901494bb1bf27abe7dfa541 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5a48efede7b48d29a3711b46cad90c1" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 41617 } } peers { permanent_uuid: "6f26187d4901494bb1bf27abe7dfa541" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 45601 } } peers { permanent_uuid: "3754064d4ed94dcf92ac79858dc3e576" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 46407 } }
I20260615 08:06:55.003947 10923 ts_tablet_manager.cc:1434] T 6475ad94b2b3438ca188be427adfa5a8 P 6f26187d4901494bb1bf27abe7dfa541: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260615 08:06:55.003978 10904 heartbeater.cc:499] Master 127.4.42.254:37809 was elected leader, sending a full tablet report...
I20260615 08:06:55.038552 10924 raft_consensus.cc:493] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260615 08:06:55.038643 10924 raft_consensus.cc:515] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5a48efede7b48d29a3711b46cad90c1" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 41617 } } peers { permanent_uuid: "6f26187d4901494bb1bf27abe7dfa541" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 45601 } } peers { permanent_uuid: "3754064d4ed94dcf92ac79858dc3e576" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 46407 } }
I20260615 08:06:55.038772 10924 leader_election.cc:290] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f26187d4901494bb1bf27abe7dfa541 (127.4.42.195:45601), 3754064d4ed94dcf92ac79858dc3e576 (127.4.42.193:46407)
I20260615 08:06:55.041224 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6475ad94b2b3438ca188be427adfa5a8" candidate_uuid: "a5a48efede7b48d29a3711b46cad90c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f26187d4901494bb1bf27abe7dfa541" is_pre_election: true
I20260615 08:06:55.041303 10878 raft_consensus.cc:2468] T 6475ad94b2b3438ca188be427adfa5a8 P 6f26187d4901494bb1bf27abe7dfa541 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5a48efede7b48d29a3711b46cad90c1 in term 0.
I20260615 08:06:55.041340 10727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6475ad94b2b3438ca188be427adfa5a8" candidate_uuid: "a5a48efede7b48d29a3711b46cad90c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3754064d4ed94dcf92ac79858dc3e576" is_pre_election: true
I20260615 08:06:55.041416 10727 raft_consensus.cc:2468] T 6475ad94b2b3438ca188be427adfa5a8 P 3754064d4ed94dcf92ac79858dc3e576 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5a48efede7b48d29a3711b46cad90c1 in term 0.
I20260615 08:06:55.041420 10769 leader_election.cc:304] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f26187d4901494bb1bf27abe7dfa541, a5a48efede7b48d29a3711b46cad90c1; no voters:
I20260615 08:06:55.041520 10924 raft_consensus.cc:2804] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260615 08:06:55.041553 10924 raft_consensus.cc:493] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:06:55.041572 10924 raft_consensus.cc:3060] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:06:55.042110 10924 raft_consensus.cc:515] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5a48efede7b48d29a3711b46cad90c1" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 41617 } } peers { permanent_uuid: "6f26187d4901494bb1bf27abe7dfa541" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 45601 } } peers { permanent_uuid: "3754064d4ed94dcf92ac79858dc3e576" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 46407 } }
I20260615 08:06:55.042224 10924 leader_election.cc:290] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1 [CANDIDATE]: Term 1 election: Requested vote from peers 6f26187d4901494bb1bf27abe7dfa541 (127.4.42.195:45601), 3754064d4ed94dcf92ac79858dc3e576 (127.4.42.193:46407)
I20260615 08:06:55.042366 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6475ad94b2b3438ca188be427adfa5a8" candidate_uuid: "a5a48efede7b48d29a3711b46cad90c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f26187d4901494bb1bf27abe7dfa541"
I20260615 08:06:55.042378 10727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6475ad94b2b3438ca188be427adfa5a8" candidate_uuid: "a5a48efede7b48d29a3711b46cad90c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3754064d4ed94dcf92ac79858dc3e576"
I20260615 08:06:55.042444 10878 raft_consensus.cc:3060] T 6475ad94b2b3438ca188be427adfa5a8 P 6f26187d4901494bb1bf27abe7dfa541 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:06:55.042450 10727 raft_consensus.cc:3060] T 6475ad94b2b3438ca188be427adfa5a8 P 3754064d4ed94dcf92ac79858dc3e576 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:06:55.043205 10878 raft_consensus.cc:2468] T 6475ad94b2b3438ca188be427adfa5a8 P 6f26187d4901494bb1bf27abe7dfa541 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5a48efede7b48d29a3711b46cad90c1 in term 1.
I20260615 08:06:55.043205 10727 raft_consensus.cc:2468] T 6475ad94b2b3438ca188be427adfa5a8 P 3754064d4ed94dcf92ac79858dc3e576 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5a48efede7b48d29a3711b46cad90c1 in term 1.
I20260615 08:06:55.043396 10769 leader_election.cc:304] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f26187d4901494bb1bf27abe7dfa541, a5a48efede7b48d29a3711b46cad90c1; no voters:
I20260615 08:06:55.043514 10924 raft_consensus.cc:2804] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:06:55.043663 10924 raft_consensus.cc:697] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1 [term 1 LEADER]: Becoming Leader. State: Replica: a5a48efede7b48d29a3711b46cad90c1, State: Running, Role: LEADER
I20260615 08:06:55.043730 10924 consensus_queue.cc:237] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5a48efede7b48d29a3711b46cad90c1" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 41617 } } peers { permanent_uuid: "6f26187d4901494bb1bf27abe7dfa541" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 45601 } } peers { permanent_uuid: "3754064d4ed94dcf92ac79858dc3e576" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 46407 } }
I20260615 08:06:55.044250 10623 catalog_manager.cc:5696] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to a5a48efede7b48d29a3711b46cad90c1 (127.4.42.194). New cstate: current_term: 1 leader_uuid: "a5a48efede7b48d29a3711b46cad90c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5a48efede7b48d29a3711b46cad90c1" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 41617 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f26187d4901494bb1bf27abe7dfa541" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 45601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3754064d4ed94dcf92ac79858dc3e576" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 46407 } health_report { overall_health: UNKNOWN } } }
I20260615 08:06:55.063957 10727 raft_consensus.cc:1275] T 6475ad94b2b3438ca188be427adfa5a8 P 3754064d4ed94dcf92ac79858dc3e576 [term 1 FOLLOWER]: Refusing update from remote peer a5a48efede7b48d29a3711b46cad90c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:06:55.063963 10878 raft_consensus.cc:1275] T 6475ad94b2b3438ca188be427adfa5a8 P 6f26187d4901494bb1bf27abe7dfa541 [term 1 FOLLOWER]: Refusing update from remote peer a5a48efede7b48d29a3711b46cad90c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:06:55.064180 10929 consensus_queue.cc:1048] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f26187d4901494bb1bf27abe7dfa541" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 45601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:06:55.064267 10924 consensus_queue.cc:1048] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3754064d4ed94dcf92ac79858dc3e576" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 46407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:07:05.462343 10969 raft_consensus.cc:993] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1: : Instructing follower 3754064d4ed94dcf92ac79858dc3e576 to start an election
I20260615 08:07:05.462422 10969 raft_consensus.cc:1081] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1 [term 1 LEADER]: Signalling peer 3754064d4ed94dcf92ac79858dc3e576 to start an election
I20260615 08:07:05.462668 10727 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6475ad94b2b3438ca188be427adfa5a8"
dest_uuid: "3754064d4ed94dcf92ac79858dc3e576"
from {username='slave'} at 127.0.0.1:40024
I20260615 08:07:05.462745 10727 raft_consensus.cc:493] T 6475ad94b2b3438ca188be427adfa5a8 P 3754064d4ed94dcf92ac79858dc3e576 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260615 08:07:05.462766 10727 raft_consensus.cc:3060] T 6475ad94b2b3438ca188be427adfa5a8 P 3754064d4ed94dcf92ac79858dc3e576 [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:07:05.463580 10727 raft_consensus.cc:515] T 6475ad94b2b3438ca188be427adfa5a8 P 3754064d4ed94dcf92ac79858dc3e576 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5a48efede7b48d29a3711b46cad90c1" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 41617 } } peers { permanent_uuid: "6f26187d4901494bb1bf27abe7dfa541" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 45601 } } peers { permanent_uuid: "3754064d4ed94dcf92ac79858dc3e576" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 46407 } }
I20260615 08:07:05.463792 10727 leader_election.cc:290] T 6475ad94b2b3438ca188be427adfa5a8 P 3754064d4ed94dcf92ac79858dc3e576 [CANDIDATE]: Term 2 election: Requested vote from peers a5a48efede7b48d29a3711b46cad90c1 (127.4.42.194:41617), 6f26187d4901494bb1bf27abe7dfa541 (127.4.42.195:45601)
I20260615 08:07:05.466388 10803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6475ad94b2b3438ca188be427adfa5a8" candidate_uuid: "3754064d4ed94dcf92ac79858dc3e576" candidate_term: 2 candidate_status { last_received { term: 1 index: 13451 } } ignore_live_leader: true dest_uuid: "a5a48efede7b48d29a3711b46cad90c1"
I20260615 08:07:05.466472 10803 raft_consensus.cc:3055] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260615 08:07:05.466531 10803 raft_consensus.cc:740] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a5a48efede7b48d29a3711b46cad90c1, State: Running, Role: LEADER
I20260615 08:07:05.466584 10803 consensus_queue.cc:260] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13451, Committed index: 13451, Last appended: 1.13451, Last appended by leader: 13451, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5a48efede7b48d29a3711b46cad90c1" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 41617 } } peers { permanent_uuid: "6f26187d4901494bb1bf27abe7dfa541" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 45601 } } peers { permanent_uuid: "3754064d4ed94dcf92ac79858dc3e576" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 46407 } }
I20260615 08:07:05.466670 10803 raft_consensus.cc:3060] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1 [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:07:05.466866 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6475ad94b2b3438ca188be427adfa5a8" candidate_uuid: "3754064d4ed94dcf92ac79858dc3e576" candidate_term: 2 candidate_status { last_received { term: 1 index: 13451 } } ignore_live_leader: true dest_uuid: "6f26187d4901494bb1bf27abe7dfa541"
I20260615 08:07:05.466928 10877 raft_consensus.cc:3060] T 6475ad94b2b3438ca188be427adfa5a8 P 6f26187d4901494bb1bf27abe7dfa541 [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:07:05.467471 10803 raft_consensus.cc:2468] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3754064d4ed94dcf92ac79858dc3e576 in term 2.
I20260615 08:07:05.467636 10877 raft_consensus.cc:2468] T 6475ad94b2b3438ca188be427adfa5a8 P 6f26187d4901494bb1bf27abe7dfa541 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3754064d4ed94dcf92ac79858dc3e576 in term 2.
I20260615 08:07:05.467708 10691 leader_election.cc:304] T 6475ad94b2b3438ca188be427adfa5a8 P 3754064d4ed94dcf92ac79858dc3e576 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3754064d4ed94dcf92ac79858dc3e576, a5a48efede7b48d29a3711b46cad90c1; no voters:
I20260615 08:07:05.467857 10976 raft_consensus.cc:2804] T 6475ad94b2b3438ca188be427adfa5a8 P 3754064d4ed94dcf92ac79858dc3e576 [term 2 FOLLOWER]: Leader election won for term 2
I20260615 08:07:05.467978 10976 raft_consensus.cc:697] T 6475ad94b2b3438ca188be427adfa5a8 P 3754064d4ed94dcf92ac79858dc3e576 [term 2 LEADER]: Becoming Leader. State: Replica: 3754064d4ed94dcf92ac79858dc3e576, State: Running, Role: LEADER
I20260615 08:07:05.468041 10976 consensus_queue.cc:237] T 6475ad94b2b3438ca188be427adfa5a8 P 3754064d4ed94dcf92ac79858dc3e576 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13451, Committed index: 13451, Last appended: 1.13451, Last appended by leader: 13451, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5a48efede7b48d29a3711b46cad90c1" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 41617 } } peers { permanent_uuid: "6f26187d4901494bb1bf27abe7dfa541" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 45601 } } peers { permanent_uuid: "3754064d4ed94dcf92ac79858dc3e576" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 46407 } }
I20260615 08:07:05.468463 10621 catalog_manager.cc:5696] T 6475ad94b2b3438ca188be427adfa5a8 P 3754064d4ed94dcf92ac79858dc3e576 reported cstate change: term changed from 1 to 2, leader changed from a5a48efede7b48d29a3711b46cad90c1 (127.4.42.194) to 3754064d4ed94dcf92ac79858dc3e576 (127.4.42.193). New cstate: current_term: 2 leader_uuid: "3754064d4ed94dcf92ac79858dc3e576" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5a48efede7b48d29a3711b46cad90c1" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 41617 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f26187d4901494bb1bf27abe7dfa541" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 45601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3754064d4ed94dcf92ac79858dc3e576" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 46407 } health_report { overall_health: HEALTHY } } }
W20260615 08:07:05.483898 10937 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54656: Illegal state: Transaction hasn't been successfully started
W20260615 08:07:05.484372 10937 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:54656: Illegal state: Transaction metadata for transaction 1 does not exist
I20260615 08:07:05.484987 10877 raft_consensus.cc:1275] T 6475ad94b2b3438ca188be427adfa5a8 P 6f26187d4901494bb1bf27abe7dfa541 [term 2 FOLLOWER]: Refusing update from remote peer 3754064d4ed94dcf92ac79858dc3e576: Log matching property violated. Preceding OpId in replica: term: 1 index: 13451. Preceding OpId from leader: term: 2 index: 13453. (index mismatch)
I20260615 08:07:05.485028 10803 raft_consensus.cc:1275] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1 [term 2 FOLLOWER]: Refusing update from remote peer 3754064d4ed94dcf92ac79858dc3e576: Log matching property violated. Preceding OpId in replica: term: 1 index: 13451. Preceding OpId from leader: term: 2 index: 13453. (index mismatch)
I20260615 08:07:05.485195 10976 consensus_queue.cc:1048] T 6475ad94b2b3438ca188be427adfa5a8 P 3754064d4ed94dcf92ac79858dc3e576 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5a48efede7b48d29a3711b46cad90c1" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 41617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13452, Last known committed idx: 13451, Time since last communication: 0.000s
I20260615 08:07:05.485344 10977 consensus_queue.cc:1048] T 6475ad94b2b3438ca188be427adfa5a8 P 3754064d4ed94dcf92ac79858dc3e576 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f26187d4901494bb1bf27abe7dfa541" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 45601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13452, Last known committed idx: 13451, Time since last communication: 0.000s
I20260615 08:07:05.487701 4267 tablet_server.cc:179] TabletServer@127.4.42.193:0 shutting down...
I20260615 08:07:05.490669 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:07:05.490765 4267 tablet_replica.cc:333] T 6475ad94b2b3438ca188be427adfa5a8 P 3754064d4ed94dcf92ac79858dc3e576: stopping tablet replica
I20260615 08:07:05.490826 4267 raft_consensus.cc:2243] T 6475ad94b2b3438ca188be427adfa5a8 P 3754064d4ed94dcf92ac79858dc3e576 [term 2 LEADER]: Raft consensus shutting down.
I20260615 08:07:05.490897 4267 raft_consensus.cc:2272] T 6475ad94b2b3438ca188be427adfa5a8 P 3754064d4ed94dcf92ac79858dc3e576 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:07:05.497923 4267 tablet_server.cc:196] TabletServer@127.4.42.193:0 shutdown complete.
I20260615 08:07:05.498956 4267 tablet_server.cc:179] TabletServer@127.4.42.194:0 shutting down...
I20260615 08:07:05.502292 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:07:05.502389 4267 tablet_replica.cc:333] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1: stopping tablet replica
I20260615 08:07:05.502449 4267 raft_consensus.cc:2243] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260615 08:07:05.502545 4267 raft_consensus.cc:2272] T 6475ad94b2b3438ca188be427adfa5a8 P a5a48efede7b48d29a3711b46cad90c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:07:05.516676 4267 tablet_server.cc:196] TabletServer@127.4.42.194:0 shutdown complete.
I20260615 08:07:05.517479 4267 tablet_server.cc:179] TabletServer@127.4.42.195:0 shutting down...
I20260615 08:07:05.521073 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:07:05.521207 4267 tablet_replica.cc:333] T 6475ad94b2b3438ca188be427adfa5a8 P 6f26187d4901494bb1bf27abe7dfa541: stopping tablet replica
I20260615 08:07:05.521261 4267 raft_consensus.cc:2243] T 6475ad94b2b3438ca188be427adfa5a8 P 6f26187d4901494bb1bf27abe7dfa541 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260615 08:07:05.521382 4267 raft_consensus.cc:2272] T 6475ad94b2b3438ca188be427adfa5a8 P 6f26187d4901494bb1bf27abe7dfa541 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:07:05.537384 4267 tablet_server.cc:196] TabletServer@127.4.42.195:0 shutdown complete.
I20260615 08:07:05.538216 4267 master.cc:562] Master@127.4.42.254:37809 shutting down...
I20260615 08:07:05.541234 4267 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4cf9d79254ee4c2a96441901f507db51 [term 1 LEADER]: Raft consensus shutting down.
I20260615 08:07:05.541309 4267 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4cf9d79254ee4c2a96441901f507db51 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:07:05.541329 4267 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4cf9d79254ee4c2a96441901f507db51: stopping tablet replica
I20260615 08:07:05.553871 4267 master.cc:584] Master@127.4.42.254:37809 shutdown complete.
[ OK ] TxnParticipantITest.TestTxnSystemClientErrorWhenNotBegun (10724 ms)
[ RUN ] TxnParticipantITest.TestTxnSystemClientRepeatCalls
I20260615 08:07:05.572467 4267 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.42.254:41055
I20260615 08:07:05.572614 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:07:05.573964 10994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:07:05.574040 10991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:07:05.574136 10992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:07:05.574251 4267 server_base.cc:1061] running on GCE node
I20260615 08:07:05.574352 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:07:05.574397 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:07:05.574410 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510825574411 us; error 0 us; skew 500 ppm
I20260615 08:07:05.574965 4267 webserver.cc:533] Webserver started at http://127.4.42.254:40989/ using document root <none> and password file <none>
I20260615 08:07:05.575029 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:07:05.575090 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:07:05.575136 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:07:05.575418 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1781510637089012-4267-0/minicluster-data/master-0-root/instance:
uuid: "c490a2096f3b4542b419de626bf2ab2d"
format_stamp: "Formatted at 2026-06-15 08:07:05 on dist-test-slave-37n8"
I20260615 08:07:05.576282 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:07:05.576735 10999 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:05.576891 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:05.576931 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1781510637089012-4267-0/minicluster-data/master-0-root
uuid: "c490a2096f3b4542b419de626bf2ab2d"
format_stamp: "Formatted at 2026-06-15 08:07:05 on dist-test-slave-37n8"
I20260615 08:07:05.576956 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1781510637089012-4267-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1781510637089012-4267-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1781510637089012-4267-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:07:05.603925 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:07:05.604130 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:07:05.606766 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.254:41055
I20260615 08:07:05.611896 11052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:07:05.612317 11051 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.254:41055 every 8 connection(s)
I20260615 08:07:05.613032 11052 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c490a2096f3b4542b419de626bf2ab2d: Bootstrap starting.
I20260615 08:07:05.613286 11052 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c490a2096f3b4542b419de626bf2ab2d: Neither blocks nor log segments found. Creating new log.
I20260615 08:07:05.613709 11052 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c490a2096f3b4542b419de626bf2ab2d: No bootstrap required, opened a new log
I20260615 08:07:05.613804 11052 raft_consensus.cc:359] T 00000000000000000000000000000000 P c490a2096f3b4542b419de626bf2ab2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c490a2096f3b4542b419de626bf2ab2d" member_type: VOTER }
I20260615 08:07:05.613847 11052 raft_consensus.cc:385] T 00000000000000000000000000000000 P c490a2096f3b4542b419de626bf2ab2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:07:05.613862 11052 raft_consensus.cc:740] T 00000000000000000000000000000000 P c490a2096f3b4542b419de626bf2ab2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c490a2096f3b4542b419de626bf2ab2d, State: Initialized, Role: FOLLOWER
I20260615 08:07:05.613924 11052 consensus_queue.cc:260] T 00000000000000000000000000000000 P c490a2096f3b4542b419de626bf2ab2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c490a2096f3b4542b419de626bf2ab2d" member_type: VOTER }
I20260615 08:07:05.613970 11052 raft_consensus.cc:399] T 00000000000000000000000000000000 P c490a2096f3b4542b419de626bf2ab2d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260615 08:07:05.613986 11052 raft_consensus.cc:493] T 00000000000000000000000000000000 P c490a2096f3b4542b419de626bf2ab2d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260615 08:07:05.613999 11052 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c490a2096f3b4542b419de626bf2ab2d [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:07:05.614427 11052 raft_consensus.cc:515] T 00000000000000000000000000000000 P c490a2096f3b4542b419de626bf2ab2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c490a2096f3b4542b419de626bf2ab2d" member_type: VOTER }
I20260615 08:07:05.614478 11052 leader_election.cc:304] T 00000000000000000000000000000000 P c490a2096f3b4542b419de626bf2ab2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c490a2096f3b4542b419de626bf2ab2d; no voters:
I20260615 08:07:05.614624 11052 leader_election.cc:290] T 00000000000000000000000000000000 P c490a2096f3b4542b419de626bf2ab2d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260615 08:07:05.614679 11055 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c490a2096f3b4542b419de626bf2ab2d [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:07:05.614787 11052 sys_catalog.cc:565] T 00000000000000000000000000000000 P c490a2096f3b4542b419de626bf2ab2d [sys.catalog]: configured and running, proceeding with master startup.
I20260615 08:07:05.614828 11055 raft_consensus.cc:697] T 00000000000000000000000000000000 P c490a2096f3b4542b419de626bf2ab2d [term 1 LEADER]: Becoming Leader. State: Replica: c490a2096f3b4542b419de626bf2ab2d, State: Running, Role: LEADER
I20260615 08:07:05.614886 11055 consensus_queue.cc:237] T 00000000000000000000000000000000 P c490a2096f3b4542b419de626bf2ab2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c490a2096f3b4542b419de626bf2ab2d" member_type: VOTER }
I20260615 08:07:05.615136 11057 sys_catalog.cc:455] T 00000000000000000000000000000000 P c490a2096f3b4542b419de626bf2ab2d [sys.catalog]: SysCatalogTable state changed. Reason: New leader c490a2096f3b4542b419de626bf2ab2d. Latest consensus state: current_term: 1 leader_uuid: "c490a2096f3b4542b419de626bf2ab2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c490a2096f3b4542b419de626bf2ab2d" member_type: VOTER } }
I20260615 08:07:05.615121 11056 sys_catalog.cc:455] T 00000000000000000000000000000000 P c490a2096f3b4542b419de626bf2ab2d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c490a2096f3b4542b419de626bf2ab2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c490a2096f3b4542b419de626bf2ab2d" member_type: VOTER } }
I20260615 08:07:05.615278 11057 sys_catalog.cc:458] T 00000000000000000000000000000000 P c490a2096f3b4542b419de626bf2ab2d [sys.catalog]: This master's current role is: LEADER
I20260615 08:07:05.615329 11056 sys_catalog.cc:458] T 00000000000000000000000000000000 P c490a2096f3b4542b419de626bf2ab2d [sys.catalog]: This master's current role is: LEADER
I20260615 08:07:05.615460 11063 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260615 08:07:05.615590 11063 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260615 08:07:05.616134 11063 catalog_manager.cc:1382] Generated new cluster ID: 7d0e5d9fc9734bbe89d30e16a9924eaa
I20260615 08:07:05.616158 4267 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260615 08:07:05.616184 11063 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260615 08:07:05.629262 11063 catalog_manager.cc:1405] Generated new certificate authority record
I20260615 08:07:05.629665 11063 catalog_manager.cc:1539] Loading token signing keys...
I20260615 08:07:05.638258 11063 catalog_manager.cc:6069] T 00000000000000000000000000000000 P c490a2096f3b4542b419de626bf2ab2d: Generated new TSK 0
I20260615 08:07:05.638335 11063 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260615 08:07:05.647974 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:07:05.649147 11074 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:07:05.649268 4267 server_base.cc:1061] running on GCE node
W20260615 08:07:05.649227 11073 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:07:05.649138 11076 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:07:05.649437 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:07:05.649482 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:07:05.649503 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510825649503 us; error 0 us; skew 500 ppm
I20260615 08:07:05.650063 4267 webserver.cc:533] Webserver started at http://127.4.42.193:45803/ using document root <none> and password file <none>
I20260615 08:07:05.650161 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:07:05.650225 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:07:05.650274 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:07:05.650589 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1781510637089012-4267-0/minicluster-data/ts-0-root/instance:
uuid: "63306d55d9ba40d8bc44a2c66fedcbaa"
format_stamp: "Formatted at 2026-06-15 08:07:05 on dist-test-slave-37n8"
I20260615 08:07:05.651468 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:07:05.651921 11081 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:05.652057 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:05.652123 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1781510637089012-4267-0/minicluster-data/ts-0-root
uuid: "63306d55d9ba40d8bc44a2c66fedcbaa"
format_stamp: "Formatted at 2026-06-15 08:07:05 on dist-test-slave-37n8"
I20260615 08:07:05.652168 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1781510637089012-4267-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1781510637089012-4267-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1781510637089012-4267-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:07:05.660848 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:07:05.661029 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:07:05.661170 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:07:05.661360 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:07:05.661405 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:05.661443 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:07:05.661469 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:05.664284 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.193:41619
I20260615 08:07:05.664937 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260615 08:07:05.665499 11144 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.193:41619 every 8 connection(s)
W20260615 08:07:05.666342 11147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:07:05.666397 11148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:07:05.666507 4267 server_base.cc:1061] running on GCE node
W20260615 08:07:05.666622 11150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:07:05.666786 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:07:05.666831 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:07:05.666844 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510825666845 us; error 0 us; skew 500 ppm
I20260615 08:07:05.667486 4267 webserver.cc:533] Webserver started at http://127.4.42.194:44341/ using document root <none> and password file <none>
I20260615 08:07:05.667587 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:07:05.667646 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:07:05.667698 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:07:05.667949 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1781510637089012-4267-0/minicluster-data/ts-1-root/instance:
uuid: "1d201f60bb62448caf450200c9a45ceb"
format_stamp: "Formatted at 2026-06-15 08:07:05 on dist-test-slave-37n8"
I20260615 08:07:05.668835 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:07:05.669610 11157 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:05.669723 11145 heartbeater.cc:344] Connected to a master server at 127.4.42.254:41055
I20260615 08:07:05.669723 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:05.669819 11145 heartbeater.cc:461] Registering TS with master...
I20260615 08:07:05.669833 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1781510637089012-4267-0/minicluster-data/ts-1-root
uuid: "1d201f60bb62448caf450200c9a45ceb"
format_stamp: "Formatted at 2026-06-15 08:07:05 on dist-test-slave-37n8"
I20260615 08:07:05.669862 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1781510637089012-4267-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1781510637089012-4267-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1781510637089012-4267-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:07:05.669937 11145 heartbeater.cc:507] Master 127.4.42.254:41055 requested a full tablet report, sending...
I20260615 08:07:05.670167 11016 ts_manager.cc:194] Registered new tserver with Master: 63306d55d9ba40d8bc44a2c66fedcbaa (127.4.42.193:41619)
I20260615 08:07:05.670882 11016 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35456
I20260615 08:07:05.680467 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:07:05.680651 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:07:05.680807 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:07:05.681008 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:07:05.681053 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:05.681092 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:07:05.681120 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:05.684257 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.194:45581
I20260615 08:07:05.684319 11220 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.194:45581 every 8 connection(s)
I20260615 08:07:05.684686 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:07:05.685772 11224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:07:05.685739 11225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:07:05.685885 11227 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:07:05.686312 4267 server_base.cc:1061] running on GCE node
I20260615 08:07:05.686465 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:07:05.686585 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:07:05.686625 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510825686625 us; error 0 us; skew 500 ppm
I20260615 08:07:05.687181 4267 webserver.cc:533] Webserver started at http://127.4.42.195:38613/ using document root <none> and password file <none>
I20260615 08:07:05.687302 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:07:05.687351 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:07:05.687397 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:07:05.687695 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1781510637089012-4267-0/minicluster-data/ts-2-root/instance:
uuid: "bd4bf62a92c64c7f8bc86c08b902da54"
format_stamp: "Formatted at 2026-06-15 08:07:05 on dist-test-slave-37n8"
I20260615 08:07:05.687780 11221 heartbeater.cc:344] Connected to a master server at 127.4.42.254:41055
I20260615 08:07:05.687844 11221 heartbeater.cc:461] Registering TS with master...
I20260615 08:07:05.687944 11221 heartbeater.cc:507] Master 127.4.42.254:41055 requested a full tablet report, sending...
I20260615 08:07:05.688194 11016 ts_manager.cc:194] Registered new tserver with Master: 1d201f60bb62448caf450200c9a45ceb (127.4.42.194:45581)
I20260615 08:07:05.688661 11016 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35460
I20260615 08:07:05.688752 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:07:05.689245 11232 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:05.689358 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260615 08:07:05.689405 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1781510637089012-4267-0/minicluster-data/ts-2-root
uuid: "bd4bf62a92c64c7f8bc86c08b902da54"
format_stamp: "Formatted at 2026-06-15 08:07:05 on dist-test-slave-37n8"
I20260615 08:07:05.689447 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1781510637089012-4267-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1781510637089012-4267-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRepeatCalls.1781510637089012-4267-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:07:05.694012 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:07:05.694217 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:07:05.694380 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:07:05.694613 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:07:05.694659 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:05.694698 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:07:05.694725 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:05.697913 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.195:33635
I20260615 08:07:05.697917 11295 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.195:33635 every 8 connection(s)
I20260615 08:07:05.700781 11296 heartbeater.cc:344] Connected to a master server at 127.4.42.254:41055
I20260615 08:07:05.700852 11296 heartbeater.cc:461] Registering TS with master...
I20260615 08:07:05.700965 11296 heartbeater.cc:507] Master 127.4.42.254:41055 requested a full tablet report, sending...
I20260615 08:07:05.701216 11016 ts_manager.cc:194] Registered new tserver with Master: bd4bf62a92c64c7f8bc86c08b902da54 (127.4.42.195:33635)
I20260615 08:07:05.701463 4267 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.00330784s
I20260615 08:07:05.701525 11016 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35472
I20260615 08:07:05.706260 11016 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35482:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260615 08:07:05.706413 11016 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260615 08:07:05.710870 11260 tablet_service.cc:1511] Processing CreateTablet for tablet 724105bc54ff4c6491531248876a7e25 (DEFAULT_TABLE table=test-workload [id=3e246ec53b4647d09392a7e314cf7eb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:07:05.710999 11260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 724105bc54ff4c6491531248876a7e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:07:05.711509 11109 tablet_service.cc:1511] Processing CreateTablet for tablet 724105bc54ff4c6491531248876a7e25 (DEFAULT_TABLE table=test-workload [id=3e246ec53b4647d09392a7e314cf7eb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:07:05.711640 11109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 724105bc54ff4c6491531248876a7e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:07:05.711726 11185 tablet_service.cc:1511] Processing CreateTablet for tablet 724105bc54ff4c6491531248876a7e25 (DEFAULT_TABLE table=test-workload [id=3e246ec53b4647d09392a7e314cf7eb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:07:05.711813 11185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 724105bc54ff4c6491531248876a7e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:07:05.712500 11311 tablet_bootstrap.cc:492] T 724105bc54ff4c6491531248876a7e25 P bd4bf62a92c64c7f8bc86c08b902da54: Bootstrap starting.
I20260615 08:07:05.712826 11312 tablet_bootstrap.cc:492] T 724105bc54ff4c6491531248876a7e25 P 63306d55d9ba40d8bc44a2c66fedcbaa: Bootstrap starting.
I20260615 08:07:05.713011 11311 tablet_bootstrap.cc:654] T 724105bc54ff4c6491531248876a7e25 P bd4bf62a92c64c7f8bc86c08b902da54: Neither blocks nor log segments found. Creating new log.
I20260615 08:07:05.713161 11313 tablet_bootstrap.cc:492] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb: Bootstrap starting.
I20260615 08:07:05.713241 11312 tablet_bootstrap.cc:654] T 724105bc54ff4c6491531248876a7e25 P 63306d55d9ba40d8bc44a2c66fedcbaa: Neither blocks nor log segments found. Creating new log.
I20260615 08:07:05.713678 11313 tablet_bootstrap.cc:654] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb: Neither blocks nor log segments found. Creating new log.
I20260615 08:07:05.713872 11312 tablet_bootstrap.cc:492] T 724105bc54ff4c6491531248876a7e25 P 63306d55d9ba40d8bc44a2c66fedcbaa: No bootstrap required, opened a new log
I20260615 08:07:05.713917 11312 ts_tablet_manager.cc:1403] T 724105bc54ff4c6491531248876a7e25 P 63306d55d9ba40d8bc44a2c66fedcbaa: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:07:05.714075 11312 raft_consensus.cc:359] T 724105bc54ff4c6491531248876a7e25 P 63306d55d9ba40d8bc44a2c66fedcbaa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd4bf62a92c64c7f8bc86c08b902da54" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33635 } } peers { permanent_uuid: "63306d55d9ba40d8bc44a2c66fedcbaa" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41619 } } peers { permanent_uuid: "1d201f60bb62448caf450200c9a45ceb" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 45581 } }
I20260615 08:07:05.714143 11312 raft_consensus.cc:385] T 724105bc54ff4c6491531248876a7e25 P 63306d55d9ba40d8bc44a2c66fedcbaa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:07:05.714192 11312 raft_consensus.cc:740] T 724105bc54ff4c6491531248876a7e25 P 63306d55d9ba40d8bc44a2c66fedcbaa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63306d55d9ba40d8bc44a2c66fedcbaa, State: Initialized, Role: FOLLOWER
I20260615 08:07:05.714249 11312 consensus_queue.cc:260] T 724105bc54ff4c6491531248876a7e25 P 63306d55d9ba40d8bc44a2c66fedcbaa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd4bf62a92c64c7f8bc86c08b902da54" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33635 } } peers { permanent_uuid: "63306d55d9ba40d8bc44a2c66fedcbaa" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41619 } } peers { permanent_uuid: "1d201f60bb62448caf450200c9a45ceb" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 45581 } }
I20260615 08:07:05.714335 11313 tablet_bootstrap.cc:492] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb: No bootstrap required, opened a new log
I20260615 08:07:05.714385 11313 ts_tablet_manager.cc:1403] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:07:05.714435 11145 heartbeater.cc:499] Master 127.4.42.254:41055 was elected leader, sending a full tablet report...
I20260615 08:07:05.714425 11312 ts_tablet_manager.cc:1434] T 724105bc54ff4c6491531248876a7e25 P 63306d55d9ba40d8bc44a2c66fedcbaa: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260615 08:07:05.714555 11313 raft_consensus.cc:359] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd4bf62a92c64c7f8bc86c08b902da54" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33635 } } peers { permanent_uuid: "63306d55d9ba40d8bc44a2c66fedcbaa" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41619 } } peers { permanent_uuid: "1d201f60bb62448caf450200c9a45ceb" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 45581 } }
I20260615 08:07:05.714629 11313 raft_consensus.cc:385] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:07:05.714663 11313 raft_consensus.cc:740] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d201f60bb62448caf450200c9a45ceb, State: Initialized, Role: FOLLOWER
I20260615 08:07:05.714707 11313 consensus_queue.cc:260] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd4bf62a92c64c7f8bc86c08b902da54" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33635 } } peers { permanent_uuid: "63306d55d9ba40d8bc44a2c66fedcbaa" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41619 } } peers { permanent_uuid: "1d201f60bb62448caf450200c9a45ceb" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 45581 } }
I20260615 08:07:05.714869 11313 ts_tablet_manager.cc:1434] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260615 08:07:05.714893 11221 heartbeater.cc:499] Master 127.4.42.254:41055 was elected leader, sending a full tablet report...
I20260615 08:07:05.715085 11311 tablet_bootstrap.cc:492] T 724105bc54ff4c6491531248876a7e25 P bd4bf62a92c64c7f8bc86c08b902da54: No bootstrap required, opened a new log
I20260615 08:07:05.715132 11311 ts_tablet_manager.cc:1403] T 724105bc54ff4c6491531248876a7e25 P bd4bf62a92c64c7f8bc86c08b902da54: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260615 08:07:05.715296 11311 raft_consensus.cc:359] T 724105bc54ff4c6491531248876a7e25 P bd4bf62a92c64c7f8bc86c08b902da54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd4bf62a92c64c7f8bc86c08b902da54" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33635 } } peers { permanent_uuid: "63306d55d9ba40d8bc44a2c66fedcbaa" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41619 } } peers { permanent_uuid: "1d201f60bb62448caf450200c9a45ceb" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 45581 } }
I20260615 08:07:05.715360 11311 raft_consensus.cc:385] T 724105bc54ff4c6491531248876a7e25 P bd4bf62a92c64c7f8bc86c08b902da54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:07:05.715381 11311 raft_consensus.cc:740] T 724105bc54ff4c6491531248876a7e25 P bd4bf62a92c64c7f8bc86c08b902da54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd4bf62a92c64c7f8bc86c08b902da54, State: Initialized, Role: FOLLOWER
I20260615 08:07:05.715420 11311 consensus_queue.cc:260] T 724105bc54ff4c6491531248876a7e25 P bd4bf62a92c64c7f8bc86c08b902da54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd4bf62a92c64c7f8bc86c08b902da54" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33635 } } peers { permanent_uuid: "63306d55d9ba40d8bc44a2c66fedcbaa" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41619 } } peers { permanent_uuid: "1d201f60bb62448caf450200c9a45ceb" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 45581 } }
I20260615 08:07:05.715629 11311 ts_tablet_manager.cc:1434] T 724105bc54ff4c6491531248876a7e25 P bd4bf62a92c64c7f8bc86c08b902da54: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:05.715654 11296 heartbeater.cc:499] Master 127.4.42.254:41055 was elected leader, sending a full tablet report...
I20260615 08:07:05.787119 11318 raft_consensus.cc:493] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260615 08:07:05.787213 11318 raft_consensus.cc:515] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd4bf62a92c64c7f8bc86c08b902da54" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33635 } } peers { permanent_uuid: "63306d55d9ba40d8bc44a2c66fedcbaa" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41619 } } peers { permanent_uuid: "1d201f60bb62448caf450200c9a45ceb" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 45581 } }
I20260615 08:07:05.787441 11318 leader_election.cc:290] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bd4bf62a92c64c7f8bc86c08b902da54 (127.4.42.195:33635), 63306d55d9ba40d8bc44a2c66fedcbaa (127.4.42.193:41619)
I20260615 08:07:05.790030 11270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724105bc54ff4c6491531248876a7e25" candidate_uuid: "1d201f60bb62448caf450200c9a45ceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd4bf62a92c64c7f8bc86c08b902da54" is_pre_election: true
I20260615 08:07:05.790140 11270 raft_consensus.cc:2468] T 724105bc54ff4c6491531248876a7e25 P bd4bf62a92c64c7f8bc86c08b902da54 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d201f60bb62448caf450200c9a45ceb in term 0.
I20260615 08:07:05.790112 11119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724105bc54ff4c6491531248876a7e25" candidate_uuid: "1d201f60bb62448caf450200c9a45ceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63306d55d9ba40d8bc44a2c66fedcbaa" is_pre_election: true
I20260615 08:07:05.790221 11119 raft_consensus.cc:2468] T 724105bc54ff4c6491531248876a7e25 P 63306d55d9ba40d8bc44a2c66fedcbaa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d201f60bb62448caf450200c9a45ceb in term 0.
I20260615 08:07:05.790319 11158 leader_election.cc:304] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d201f60bb62448caf450200c9a45ceb, bd4bf62a92c64c7f8bc86c08b902da54; no voters:
I20260615 08:07:05.790422 11318 raft_consensus.cc:2804] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260615 08:07:05.790519 11318 raft_consensus.cc:493] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:07:05.790542 11318 raft_consensus.cc:3060] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:07:05.791141 11318 raft_consensus.cc:515] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd4bf62a92c64c7f8bc86c08b902da54" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33635 } } peers { permanent_uuid: "63306d55d9ba40d8bc44a2c66fedcbaa" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41619 } } peers { permanent_uuid: "1d201f60bb62448caf450200c9a45ceb" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 45581 } }
I20260615 08:07:05.791270 11318 leader_election.cc:290] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb [CANDIDATE]: Term 1 election: Requested vote from peers bd4bf62a92c64c7f8bc86c08b902da54 (127.4.42.195:33635), 63306d55d9ba40d8bc44a2c66fedcbaa (127.4.42.193:41619)
I20260615 08:07:05.791384 11270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724105bc54ff4c6491531248876a7e25" candidate_uuid: "1d201f60bb62448caf450200c9a45ceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd4bf62a92c64c7f8bc86c08b902da54"
I20260615 08:07:05.791404 11119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724105bc54ff4c6491531248876a7e25" candidate_uuid: "1d201f60bb62448caf450200c9a45ceb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63306d55d9ba40d8bc44a2c66fedcbaa"
I20260615 08:07:05.791473 11270 raft_consensus.cc:3060] T 724105bc54ff4c6491531248876a7e25 P bd4bf62a92c64c7f8bc86c08b902da54 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:07:05.791504 11119 raft_consensus.cc:3060] T 724105bc54ff4c6491531248876a7e25 P 63306d55d9ba40d8bc44a2c66fedcbaa [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:07:05.792102 11270 raft_consensus.cc:2468] T 724105bc54ff4c6491531248876a7e25 P bd4bf62a92c64c7f8bc86c08b902da54 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d201f60bb62448caf450200c9a45ceb in term 1.
I20260615 08:07:05.792245 11119 raft_consensus.cc:2468] T 724105bc54ff4c6491531248876a7e25 P 63306d55d9ba40d8bc44a2c66fedcbaa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d201f60bb62448caf450200c9a45ceb in term 1.
I20260615 08:07:05.792321 11158 leader_election.cc:304] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d201f60bb62448caf450200c9a45ceb, bd4bf62a92c64c7f8bc86c08b902da54; no voters:
I20260615 08:07:05.792418 11318 raft_consensus.cc:2804] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:07:05.792565 11318 raft_consensus.cc:697] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb [term 1 LEADER]: Becoming Leader. State: Replica: 1d201f60bb62448caf450200c9a45ceb, State: Running, Role: LEADER
I20260615 08:07:05.792622 11318 consensus_queue.cc:237] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd4bf62a92c64c7f8bc86c08b902da54" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33635 } } peers { permanent_uuid: "63306d55d9ba40d8bc44a2c66fedcbaa" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41619 } } peers { permanent_uuid: "1d201f60bb62448caf450200c9a45ceb" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 45581 } }
I20260615 08:07:05.793164 11016 catalog_manager.cc:5696] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d201f60bb62448caf450200c9a45ceb (127.4.42.194). New cstate: current_term: 1 leader_uuid: "1d201f60bb62448caf450200c9a45ceb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd4bf62a92c64c7f8bc86c08b902da54" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63306d55d9ba40d8bc44a2c66fedcbaa" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d201f60bb62448caf450200c9a45ceb" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 45581 } health_report { overall_health: HEALTHY } } }
I20260615 08:07:05.810379 11119 raft_consensus.cc:1275] T 724105bc54ff4c6491531248876a7e25 P 63306d55d9ba40d8bc44a2c66fedcbaa [term 1 FOLLOWER]: Refusing update from remote peer 1d201f60bb62448caf450200c9a45ceb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:07:05.810539 11270 raft_consensus.cc:1275] T 724105bc54ff4c6491531248876a7e25 P bd4bf62a92c64c7f8bc86c08b902da54 [term 1 FOLLOWER]: Refusing update from remote peer 1d201f60bb62448caf450200c9a45ceb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:07:05.810598 11318 consensus_queue.cc:1048] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "63306d55d9ba40d8bc44a2c66fedcbaa" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:07:05.810745 11321 consensus_queue.cc:1048] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd4bf62a92c64c7f8bc86c08b902da54" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:07:05.813180 11329 mvcc.cc:204] Tried to move back new op lower bound from 7297068342519590912 to 7297068342447067136. Current Snapshot: MvccSnapshot[applied={T|T < 7297068342519164928}]
I20260615 08:07:16.226984 11345 raft_consensus.cc:993] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb: : Instructing follower 63306d55d9ba40d8bc44a2c66fedcbaa to start an election
I20260615 08:07:16.227087 11345 raft_consensus.cc:1081] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb [term 1 LEADER]: Signalling peer 63306d55d9ba40d8bc44a2c66fedcbaa to start an election
I20260615 08:07:16.227290 11118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "724105bc54ff4c6491531248876a7e25"
dest_uuid: "63306d55d9ba40d8bc44a2c66fedcbaa"
from {username='slave'} at 127.0.0.1:41900
I20260615 08:07:16.227356 11118 raft_consensus.cc:493] T 724105bc54ff4c6491531248876a7e25 P 63306d55d9ba40d8bc44a2c66fedcbaa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260615 08:07:16.227378 11118 raft_consensus.cc:3060] T 724105bc54ff4c6491531248876a7e25 P 63306d55d9ba40d8bc44a2c66fedcbaa [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:07:16.227977 11118 raft_consensus.cc:515] T 724105bc54ff4c6491531248876a7e25 P 63306d55d9ba40d8bc44a2c66fedcbaa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd4bf62a92c64c7f8bc86c08b902da54" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33635 } } peers { permanent_uuid: "63306d55d9ba40d8bc44a2c66fedcbaa" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41619 } } peers { permanent_uuid: "1d201f60bb62448caf450200c9a45ceb" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 45581 } }
I20260615 08:07:16.228134 11118 leader_election.cc:290] T 724105bc54ff4c6491531248876a7e25 P 63306d55d9ba40d8bc44a2c66fedcbaa [CANDIDATE]: Term 2 election: Requested vote from peers bd4bf62a92c64c7f8bc86c08b902da54 (127.4.42.195:33635), 1d201f60bb62448caf450200c9a45ceb (127.4.42.194:45581)
I20260615 08:07:16.230894 11270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724105bc54ff4c6491531248876a7e25" candidate_uuid: "63306d55d9ba40d8bc44a2c66fedcbaa" candidate_term: 2 candidate_status { last_received { term: 1 index: 13719 } } ignore_live_leader: true dest_uuid: "bd4bf62a92c64c7f8bc86c08b902da54"
I20260615 08:07:16.230952 11195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724105bc54ff4c6491531248876a7e25" candidate_uuid: "63306d55d9ba40d8bc44a2c66fedcbaa" candidate_term: 2 candidate_status { last_received { term: 1 index: 13719 } } ignore_live_leader: true dest_uuid: "1d201f60bb62448caf450200c9a45ceb"
I20260615 08:07:16.230979 11270 raft_consensus.cc:3060] T 724105bc54ff4c6491531248876a7e25 P bd4bf62a92c64c7f8bc86c08b902da54 [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:07:16.231061 11195 raft_consensus.cc:3055] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb [term 1 LEADER]: Stepping down as leader of term 1
I20260615 08:07:16.231099 11195 raft_consensus.cc:740] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1d201f60bb62448caf450200c9a45ceb, State: Running, Role: LEADER
I20260615 08:07:16.231166 11195 consensus_queue.cc:260] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13719, Committed index: 13719, Last appended: 1.13719, Last appended by leader: 13719, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd4bf62a92c64c7f8bc86c08b902da54" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33635 } } peers { permanent_uuid: "63306d55d9ba40d8bc44a2c66fedcbaa" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41619 } } peers { permanent_uuid: "1d201f60bb62448caf450200c9a45ceb" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 45581 } }
I20260615 08:07:16.231257 11195 raft_consensus.cc:3060] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:07:16.231714 11270 raft_consensus.cc:2468] T 724105bc54ff4c6491531248876a7e25 P bd4bf62a92c64c7f8bc86c08b902da54 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63306d55d9ba40d8bc44a2c66fedcbaa in term 2.
I20260615 08:07:16.231877 11195 raft_consensus.cc:2468] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63306d55d9ba40d8bc44a2c66fedcbaa in term 2.
I20260615 08:07:16.231911 11082 leader_election.cc:304] T 724105bc54ff4c6491531248876a7e25 P 63306d55d9ba40d8bc44a2c66fedcbaa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63306d55d9ba40d8bc44a2c66fedcbaa, bd4bf62a92c64c7f8bc86c08b902da54; no voters:
I20260615 08:07:16.232108 11371 raft_consensus.cc:2804] T 724105bc54ff4c6491531248876a7e25 P 63306d55d9ba40d8bc44a2c66fedcbaa [term 2 FOLLOWER]: Leader election won for term 2
I20260615 08:07:16.232245 11371 raft_consensus.cc:697] T 724105bc54ff4c6491531248876a7e25 P 63306d55d9ba40d8bc44a2c66fedcbaa [term 2 LEADER]: Becoming Leader. State: Replica: 63306d55d9ba40d8bc44a2c66fedcbaa, State: Running, Role: LEADER
I20260615 08:07:16.232312 11371 consensus_queue.cc:237] T 724105bc54ff4c6491531248876a7e25 P 63306d55d9ba40d8bc44a2c66fedcbaa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13719, Committed index: 13719, Last appended: 1.13719, Last appended by leader: 13719, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd4bf62a92c64c7f8bc86c08b902da54" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33635 } } peers { permanent_uuid: "63306d55d9ba40d8bc44a2c66fedcbaa" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41619 } } peers { permanent_uuid: "1d201f60bb62448caf450200c9a45ceb" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 45581 } }
I20260615 08:07:16.232746 11013 catalog_manager.cc:5696] T 724105bc54ff4c6491531248876a7e25 P 63306d55d9ba40d8bc44a2c66fedcbaa reported cstate change: term changed from 1 to 2, leader changed from 1d201f60bb62448caf450200c9a45ceb (127.4.42.194) to 63306d55d9ba40d8bc44a2c66fedcbaa (127.4.42.193). New cstate: current_term: 2 leader_uuid: "63306d55d9ba40d8bc44a2c66fedcbaa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bd4bf62a92c64c7f8bc86c08b902da54" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63306d55d9ba40d8bc44a2c66fedcbaa" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d201f60bb62448caf450200c9a45ceb" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 45581 } health_report { overall_health: UNKNOWN } } }
I20260615 08:07:16.241026 11195 raft_consensus.cc:1275] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb [term 2 FOLLOWER]: Refusing update from remote peer 63306d55d9ba40d8bc44a2c66fedcbaa: Log matching property violated. Preceding OpId in replica: term: 1 index: 13719. Preceding OpId from leader: term: 2 index: 13721. (index mismatch)
I20260615 08:07:16.241056 11270 raft_consensus.cc:1275] T 724105bc54ff4c6491531248876a7e25 P bd4bf62a92c64c7f8bc86c08b902da54 [term 2 FOLLOWER]: Refusing update from remote peer 63306d55d9ba40d8bc44a2c66fedcbaa: Log matching property violated. Preceding OpId in replica: term: 1 index: 13719. Preceding OpId from leader: term: 2 index: 13721. (index mismatch)
I20260615 08:07:16.241215 11371 consensus_queue.cc:1048] T 724105bc54ff4c6491531248876a7e25 P 63306d55d9ba40d8bc44a2c66fedcbaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d201f60bb62448caf450200c9a45ceb" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 45581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13720, Last known committed idx: 13719, Time since last communication: 0.000s
I20260615 08:07:16.241320 11372 consensus_queue.cc:1048] T 724105bc54ff4c6491531248876a7e25 P 63306d55d9ba40d8bc44a2c66fedcbaa [LEADER]: Connected to new peer: Peer: permanent_uuid: "bd4bf62a92c64c7f8bc86c08b902da54" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13720, Last known committed idx: 13719, Time since last communication: 0.000s
W20260615 08:07:16.242754 11329 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36012: Illegal state: Transaction 1 already open
W20260615 08:07:16.244107 11329 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36012: Illegal state: Transaction 1 commit already in progress
W20260615 08:07:16.245599 11329 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36012: Illegal state: Transaction metadata for transaction 1 already set
W20260615 08:07:16.246851 11329 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36012: Illegal state: Transaction 2 already open
W20260615 08:07:16.247967 11329 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36012: Illegal state: Transaction 2 commit already in progress
W20260615 08:07:16.249233 11329 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36012: Illegal state: Transaction metadata for transaction 2 already set
I20260615 08:07:16.249552 4267 tablet_server.cc:179] TabletServer@127.4.42.193:0 shutting down...
I20260615 08:07:16.252135 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:07:16.252246 4267 tablet_replica.cc:333] T 724105bc54ff4c6491531248876a7e25 P 63306d55d9ba40d8bc44a2c66fedcbaa: stopping tablet replica
I20260615 08:07:16.252318 4267 raft_consensus.cc:2243] T 724105bc54ff4c6491531248876a7e25 P 63306d55d9ba40d8bc44a2c66fedcbaa [term 2 LEADER]: Raft consensus shutting down.
I20260615 08:07:16.252373 4267 raft_consensus.cc:2272] T 724105bc54ff4c6491531248876a7e25 P 63306d55d9ba40d8bc44a2c66fedcbaa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:07:16.266223 4267 tablet_server.cc:196] TabletServer@127.4.42.193:0 shutdown complete.
I20260615 08:07:16.267035 4267 tablet_server.cc:179] TabletServer@127.4.42.194:0 shutting down...
I20260615 08:07:16.269599 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:07:16.269695 4267 tablet_replica.cc:333] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb: stopping tablet replica
I20260615 08:07:16.269750 4267 raft_consensus.cc:2243] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260615 08:07:16.269796 4267 raft_consensus.cc:2272] T 724105bc54ff4c6491531248876a7e25 P 1d201f60bb62448caf450200c9a45ceb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:07:16.288707 4267 tablet_server.cc:196] TabletServer@127.4.42.194:0 shutdown complete.
I20260615 08:07:16.289475 4267 tablet_server.cc:179] TabletServer@127.4.42.195:0 shutting down...
I20260615 08:07:16.292460 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:07:16.292559 4267 tablet_replica.cc:333] T 724105bc54ff4c6491531248876a7e25 P bd4bf62a92c64c7f8bc86c08b902da54: stopping tablet replica
I20260615 08:07:16.292619 4267 raft_consensus.cc:2243] T 724105bc54ff4c6491531248876a7e25 P bd4bf62a92c64c7f8bc86c08b902da54 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260615 08:07:16.292665 4267 raft_consensus.cc:2272] T 724105bc54ff4c6491531248876a7e25 P bd4bf62a92c64c7f8bc86c08b902da54 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:07:16.316114 4267 tablet_server.cc:196] TabletServer@127.4.42.195:0 shutdown complete.
I20260615 08:07:16.317112 4267 master.cc:562] Master@127.4.42.254:41055 shutting down...
I20260615 08:07:16.319393 4267 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c490a2096f3b4542b419de626bf2ab2d [term 1 LEADER]: Raft consensus shutting down.
I20260615 08:07:16.319492 4267 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c490a2096f3b4542b419de626bf2ab2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:07:16.319530 4267 tablet_replica.cc:333] T 00000000000000000000000000000000 P c490a2096f3b4542b419de626bf2ab2d: stopping tablet replica
I20260615 08:07:16.331248 4267 master.cc:584] Master@127.4.42.254:41055 shutdown complete.
[ OK ] TxnParticipantITest.TestTxnSystemClientRepeatCalls (10777 ms)
[ RUN ] TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority
I20260615 08:07:16.349985 4267 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.42.254:36345
I20260615 08:07:16.350162 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:07:16.351764 11389 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:07:16.351811 11386 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:07:16.351864 11387 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:07:16.351902 4267 server_base.cc:1061] running on GCE node
I20260615 08:07:16.352109 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:07:16.352136 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:07:16.352159 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510836352160 us; error 0 us; skew 500 ppm
I20260615 08:07:16.352680 4267 webserver.cc:533] Webserver started at http://127.4.42.254:41331/ using document root <none> and password file <none>
I20260615 08:07:16.352777 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:07:16.352821 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:07:16.352869 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:07:16.353137 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1781510637089012-4267-0/minicluster-data/master-0-root/instance:
uuid: "99037bdd3c4d477ba0fcd16128749fb7"
format_stamp: "Formatted at 2026-06-15 08:07:16 on dist-test-slave-37n8"
I20260615 08:07:16.353996 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:07:16.354442 11394 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:16.354646 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:16.354704 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1781510637089012-4267-0/minicluster-data/master-0-root
uuid: "99037bdd3c4d477ba0fcd16128749fb7"
format_stamp: "Formatted at 2026-06-15 08:07:16 on dist-test-slave-37n8"
I20260615 08:07:16.354753 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1781510637089012-4267-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1781510637089012-4267-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1781510637089012-4267-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:07:16.364591 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:07:16.364763 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:07:16.367264 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.254:36345
I20260615 08:07:16.368752 11446 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.254:36345 every 8 connection(s)
I20260615 08:07:16.368853 11447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:07:16.369702 11447 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99037bdd3c4d477ba0fcd16128749fb7: Bootstrap starting.
I20260615 08:07:16.369959 11447 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 99037bdd3c4d477ba0fcd16128749fb7: Neither blocks nor log segments found. Creating new log.
I20260615 08:07:16.370425 11447 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99037bdd3c4d477ba0fcd16128749fb7: No bootstrap required, opened a new log
I20260615 08:07:16.370594 11447 raft_consensus.cc:359] T 00000000000000000000000000000000 P 99037bdd3c4d477ba0fcd16128749fb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99037bdd3c4d477ba0fcd16128749fb7" member_type: VOTER }
I20260615 08:07:16.370641 11447 raft_consensus.cc:385] T 00000000000000000000000000000000 P 99037bdd3c4d477ba0fcd16128749fb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:07:16.370656 11447 raft_consensus.cc:740] T 00000000000000000000000000000000 P 99037bdd3c4d477ba0fcd16128749fb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99037bdd3c4d477ba0fcd16128749fb7, State: Initialized, Role: FOLLOWER
I20260615 08:07:16.370708 11447 consensus_queue.cc:260] T 00000000000000000000000000000000 P 99037bdd3c4d477ba0fcd16128749fb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99037bdd3c4d477ba0fcd16128749fb7" member_type: VOTER }
I20260615 08:07:16.370761 11447 raft_consensus.cc:399] T 00000000000000000000000000000000 P 99037bdd3c4d477ba0fcd16128749fb7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260615 08:07:16.370780 11447 raft_consensus.cc:493] T 00000000000000000000000000000000 P 99037bdd3c4d477ba0fcd16128749fb7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260615 08:07:16.370805 11447 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 99037bdd3c4d477ba0fcd16128749fb7 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:07:16.371225 11447 raft_consensus.cc:515] T 00000000000000000000000000000000 P 99037bdd3c4d477ba0fcd16128749fb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99037bdd3c4d477ba0fcd16128749fb7" member_type: VOTER }
I20260615 08:07:16.371274 11447 leader_election.cc:304] T 00000000000000000000000000000000 P 99037bdd3c4d477ba0fcd16128749fb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 99037bdd3c4d477ba0fcd16128749fb7; no voters:
I20260615 08:07:16.371352 11447 leader_election.cc:290] T 00000000000000000000000000000000 P 99037bdd3c4d477ba0fcd16128749fb7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260615 08:07:16.371402 11450 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 99037bdd3c4d477ba0fcd16128749fb7 [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:07:16.371508 11447 sys_catalog.cc:565] T 00000000000000000000000000000000 P 99037bdd3c4d477ba0fcd16128749fb7 [sys.catalog]: configured and running, proceeding with master startup.
I20260615 08:07:16.371522 11450 raft_consensus.cc:697] T 00000000000000000000000000000000 P 99037bdd3c4d477ba0fcd16128749fb7 [term 1 LEADER]: Becoming Leader. State: Replica: 99037bdd3c4d477ba0fcd16128749fb7, State: Running, Role: LEADER
I20260615 08:07:16.371587 11450 consensus_queue.cc:237] T 00000000000000000000000000000000 P 99037bdd3c4d477ba0fcd16128749fb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99037bdd3c4d477ba0fcd16128749fb7" member_type: VOTER }
I20260615 08:07:16.371802 11452 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99037bdd3c4d477ba0fcd16128749fb7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 99037bdd3c4d477ba0fcd16128749fb7. Latest consensus state: current_term: 1 leader_uuid: "99037bdd3c4d477ba0fcd16128749fb7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99037bdd3c4d477ba0fcd16128749fb7" member_type: VOTER } }
I20260615 08:07:16.371799 11451 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99037bdd3c4d477ba0fcd16128749fb7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "99037bdd3c4d477ba0fcd16128749fb7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99037bdd3c4d477ba0fcd16128749fb7" member_type: VOTER } }
I20260615 08:07:16.371894 11452 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99037bdd3c4d477ba0fcd16128749fb7 [sys.catalog]: This master's current role is: LEADER
I20260615 08:07:16.371902 11451 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99037bdd3c4d477ba0fcd16128749fb7 [sys.catalog]: This master's current role is: LEADER
I20260615 08:07:16.372066 11455 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260615 08:07:16.372232 11455 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260615 08:07:16.372767 11455 catalog_manager.cc:1382] Generated new cluster ID: ec139840d6534e1fb9b59a38277c400c
I20260615 08:07:16.372813 11455 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260615 08:07:16.372869 4267 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260615 08:07:16.377677 11455 catalog_manager.cc:1405] Generated new certificate authority record
I20260615 08:07:16.378082 11455 catalog_manager.cc:1539] Loading token signing keys...
I20260615 08:07:16.381716 11455 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 99037bdd3c4d477ba0fcd16128749fb7: Generated new TSK 0
I20260615 08:07:16.381809 11455 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260615 08:07:16.388536 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:07:16.389755 11468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:07:16.389786 11471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:07:16.389806 4267 server_base.cc:1061] running on GCE node
W20260615 08:07:16.389923 11469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:07:16.390027 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:07:16.390062 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:07:16.390084 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510836390085 us; error 0 us; skew 500 ppm
I20260615 08:07:16.390646 4267 webserver.cc:533] Webserver started at http://127.4.42.193:39279/ using document root <none> and password file <none>
I20260615 08:07:16.390754 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:07:16.390790 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:07:16.390825 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:07:16.391036 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1781510637089012-4267-0/minicluster-data/ts-0-root/instance:
uuid: "4deb3a4f744645b5bb1023e008a0735f"
format_stamp: "Formatted at 2026-06-15 08:07:16 on dist-test-slave-37n8"
I20260615 08:07:16.391842 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:07:16.392234 11476 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:16.392366 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:16.392412 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1781510637089012-4267-0/minicluster-data/ts-0-root
uuid: "4deb3a4f744645b5bb1023e008a0735f"
format_stamp: "Formatted at 2026-06-15 08:07:16 on dist-test-slave-37n8"
I20260615 08:07:16.392462 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1781510637089012-4267-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1781510637089012-4267-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1781510637089012-4267-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:07:16.407289 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:07:16.407466 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:07:16.407572 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:07:16.407768 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:07:16.407794 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:16.407843 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:07:16.407869 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:16.410458 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.193:33379
I20260615 08:07:16.411118 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260615 08:07:16.412384 11539 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.193:33379 every 8 connection(s)
W20260615 08:07:16.413118 11542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:07:16.413228 11545 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:07:16.413127 11543 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:07:16.413646 4267 server_base.cc:1061] running on GCE node
I20260615 08:07:16.413750 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:07:16.413781 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:07:16.413810 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510836413809 us; error 0 us; skew 500 ppm
I20260615 08:07:16.414464 4267 webserver.cc:533] Webserver started at http://127.4.42.194:38487/ using document root <none> and password file <none>
I20260615 08:07:16.414570 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:07:16.414611 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:07:16.414651 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:07:16.414906 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1781510637089012-4267-0/minicluster-data/ts-1-root/instance:
uuid: "b56f1d19e9684785beb5b1ea2af1e08e"
format_stamp: "Formatted at 2026-06-15 08:07:16 on dist-test-slave-37n8"
I20260615 08:07:16.416039 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:07:16.416555 11552 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:16.416694 11540 heartbeater.cc:344] Connected to a master server at 127.4.42.254:36345
I20260615 08:07:16.416709 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:16.416767 11540 heartbeater.cc:461] Registering TS with master...
I20260615 08:07:16.416774 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1781510637089012-4267-0/minicluster-data/ts-1-root
uuid: "b56f1d19e9684785beb5b1ea2af1e08e"
format_stamp: "Formatted at 2026-06-15 08:07:16 on dist-test-slave-37n8"
I20260615 08:07:16.416841 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1781510637089012-4267-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1781510637089012-4267-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1781510637089012-4267-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:07:16.416895 11540 heartbeater.cc:507] Master 127.4.42.254:36345 requested a full tablet report, sending...
I20260615 08:07:16.417129 11411 ts_manager.cc:194] Registered new tserver with Master: 4deb3a4f744645b5bb1023e008a0735f (127.4.42.193:33379)
I20260615 08:07:16.417757 11411 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35660
I20260615 08:07:16.431301 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:07:16.431478 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:07:16.431617 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:07:16.431802 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:07:16.431828 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:16.431862 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:07:16.431890 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:16.434971 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.194:39981
I20260615 08:07:16.435035 11615 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.194:39981 every 8 connection(s)
I20260615 08:07:16.435366 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:07:16.436384 11619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:07:16.436499 11620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:07:16.436641 11622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:07:16.436728 4267 server_base.cc:1061] running on GCE node
I20260615 08:07:16.436904 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:07:16.436965 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:07:16.436990 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510836436988 us; error 0 us; skew 500 ppm
I20260615 08:07:16.437518 4267 webserver.cc:533] Webserver started at http://127.4.42.195:39013/ using document root <none> and password file <none>
I20260615 08:07:16.437599 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:07:16.437650 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:07:16.437691 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:07:16.437994 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1781510637089012-4267-0/minicluster-data/ts-2-root/instance:
uuid: "8d79ad9cb87f45aca45d94809785675a"
format_stamp: "Formatted at 2026-06-15 08:07:16 on dist-test-slave-37n8"
I20260615 08:07:16.438609 11616 heartbeater.cc:344] Connected to a master server at 127.4.42.254:36345
I20260615 08:07:16.438674 11616 heartbeater.cc:461] Registering TS with master...
I20260615 08:07:16.438781 11616 heartbeater.cc:507] Master 127.4.42.254:36345 requested a full tablet report, sending...
I20260615 08:07:16.439016 11411 ts_manager.cc:194] Registered new tserver with Master: b56f1d19e9684785beb5b1ea2af1e08e (127.4.42.194:39981)
I20260615 08:07:16.439147 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:07:16.439502 11411 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35676
I20260615 08:07:16.439672 11627 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:16.439800 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:16.439851 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1781510637089012-4267-0/minicluster-data/ts-2-root
uuid: "8d79ad9cb87f45aca45d94809785675a"
format_stamp: "Formatted at 2026-06-15 08:07:16 on dist-test-slave-37n8"
I20260615 08:07:16.439894 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1781510637089012-4267-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1781510637089012-4267-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1781510637089012-4267-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:07:16.447000 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:07:16.447167 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:07:16.447286 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:07:16.447475 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:07:16.447501 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:16.447546 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:07:16.447574 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:16.450724 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.195:40985
I20260615 08:07:16.450789 11690 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.195:40985 every 8 connection(s)
I20260615 08:07:16.453516 11691 heartbeater.cc:344] Connected to a master server at 127.4.42.254:36345
I20260615 08:07:16.453577 11691 heartbeater.cc:461] Registering TS with master...
I20260615 08:07:16.453680 11691 heartbeater.cc:507] Master 127.4.42.254:36345 requested a full tablet report, sending...
I20260615 08:07:16.453923 11411 ts_manager.cc:194] Registered new tserver with Master: 8d79ad9cb87f45aca45d94809785675a (127.4.42.195:40985)
I20260615 08:07:16.454224 4267 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003299214s
I20260615 08:07:16.454321 11411 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35680
I20260615 08:07:16.458732 11411 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35688:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260615 08:07:16.458889 11411 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260615 08:07:16.463413 11580 tablet_service.cc:1511] Processing CreateTablet for tablet caf3ba97ed764a3f91087192d093b74f (DEFAULT_TABLE table=test-workload [id=17507685417a46a0b7dc252db97e4cd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:07:16.463533 11580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caf3ba97ed764a3f91087192d093b74f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:07:16.463629 11655 tablet_service.cc:1511] Processing CreateTablet for tablet caf3ba97ed764a3f91087192d093b74f (DEFAULT_TABLE table=test-workload [id=17507685417a46a0b7dc252db97e4cd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:07:16.463759 11655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caf3ba97ed764a3f91087192d093b74f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:07:16.463821 11504 tablet_service.cc:1511] Processing CreateTablet for tablet caf3ba97ed764a3f91087192d093b74f (DEFAULT_TABLE table=test-workload [id=17507685417a46a0b7dc252db97e4cd1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:07:16.463915 11504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caf3ba97ed764a3f91087192d093b74f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:07:16.464793 11706 tablet_bootstrap.cc:492] T caf3ba97ed764a3f91087192d093b74f P b56f1d19e9684785beb5b1ea2af1e08e: Bootstrap starting.
I20260615 08:07:16.465206 11707 tablet_bootstrap.cc:492] T caf3ba97ed764a3f91087192d093b74f P 4deb3a4f744645b5bb1023e008a0735f: Bootstrap starting.
I20260615 08:07:16.465371 11706 tablet_bootstrap.cc:654] T caf3ba97ed764a3f91087192d093b74f P b56f1d19e9684785beb5b1ea2af1e08e: Neither blocks nor log segments found. Creating new log.
I20260615 08:07:16.465658 11707 tablet_bootstrap.cc:654] T caf3ba97ed764a3f91087192d093b74f P 4deb3a4f744645b5bb1023e008a0735f: Neither blocks nor log segments found. Creating new log.
I20260615 08:07:16.466024 11708 tablet_bootstrap.cc:492] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a: Bootstrap starting.
I20260615 08:07:16.466048 11706 tablet_bootstrap.cc:492] T caf3ba97ed764a3f91087192d093b74f P b56f1d19e9684785beb5b1ea2af1e08e: No bootstrap required, opened a new log
I20260615 08:07:16.466154 11706 ts_tablet_manager.cc:1403] T caf3ba97ed764a3f91087192d093b74f P b56f1d19e9684785beb5b1ea2af1e08e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:07:16.466197 11707 tablet_bootstrap.cc:492] T caf3ba97ed764a3f91087192d093b74f P 4deb3a4f744645b5bb1023e008a0735f: No bootstrap required, opened a new log
I20260615 08:07:16.466286 11707 ts_tablet_manager.cc:1403] T caf3ba97ed764a3f91087192d093b74f P 4deb3a4f744645b5bb1023e008a0735f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:07:16.466349 11706 raft_consensus.cc:359] T caf3ba97ed764a3f91087192d093b74f P b56f1d19e9684785beb5b1ea2af1e08e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d79ad9cb87f45aca45d94809785675a" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40985 } } peers { permanent_uuid: "b56f1d19e9684785beb5b1ea2af1e08e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39981 } } peers { permanent_uuid: "4deb3a4f744645b5bb1023e008a0735f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33379 } }
I20260615 08:07:16.466428 11706 raft_consensus.cc:385] T caf3ba97ed764a3f91087192d093b74f P b56f1d19e9684785beb5b1ea2af1e08e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:07:16.466454 11706 raft_consensus.cc:740] T caf3ba97ed764a3f91087192d093b74f P b56f1d19e9684785beb5b1ea2af1e08e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b56f1d19e9684785beb5b1ea2af1e08e, State: Initialized, Role: FOLLOWER
I20260615 08:07:16.466449 11707 raft_consensus.cc:359] T caf3ba97ed764a3f91087192d093b74f P 4deb3a4f744645b5bb1023e008a0735f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d79ad9cb87f45aca45d94809785675a" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40985 } } peers { permanent_uuid: "b56f1d19e9684785beb5b1ea2af1e08e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39981 } } peers { permanent_uuid: "4deb3a4f744645b5bb1023e008a0735f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33379 } }
I20260615 08:07:16.466557 11707 raft_consensus.cc:385] T caf3ba97ed764a3f91087192d093b74f P 4deb3a4f744645b5bb1023e008a0735f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:07:16.466607 11708 tablet_bootstrap.cc:654] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a: Neither blocks nor log segments found. Creating new log.
I20260615 08:07:16.466615 11707 raft_consensus.cc:740] T caf3ba97ed764a3f91087192d093b74f P 4deb3a4f744645b5bb1023e008a0735f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4deb3a4f744645b5bb1023e008a0735f, State: Initialized, Role: FOLLOWER
I20260615 08:07:16.466598 11706 consensus_queue.cc:260] T caf3ba97ed764a3f91087192d093b74f P b56f1d19e9684785beb5b1ea2af1e08e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d79ad9cb87f45aca45d94809785675a" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40985 } } peers { permanent_uuid: "b56f1d19e9684785beb5b1ea2af1e08e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39981 } } peers { permanent_uuid: "4deb3a4f744645b5bb1023e008a0735f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33379 } }
I20260615 08:07:16.466727 11707 consensus_queue.cc:260] T caf3ba97ed764a3f91087192d093b74f P 4deb3a4f744645b5bb1023e008a0735f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d79ad9cb87f45aca45d94809785675a" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40985 } } peers { permanent_uuid: "b56f1d19e9684785beb5b1ea2af1e08e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39981 } } peers { permanent_uuid: "4deb3a4f744645b5bb1023e008a0735f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33379 } }
I20260615 08:07:16.466852 11706 ts_tablet_manager.cc:1434] T caf3ba97ed764a3f91087192d093b74f P b56f1d19e9684785beb5b1ea2af1e08e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:07:16.466931 11540 heartbeater.cc:499] Master 127.4.42.254:36345 was elected leader, sending a full tablet report...
I20260615 08:07:16.466990 11616 heartbeater.cc:499] Master 127.4.42.254:36345 was elected leader, sending a full tablet report...
I20260615 08:07:16.466910 11707 ts_tablet_manager.cc:1434] T caf3ba97ed764a3f91087192d093b74f P 4deb3a4f744645b5bb1023e008a0735f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:07:16.467346 11708 tablet_bootstrap.cc:492] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a: No bootstrap required, opened a new log
I20260615 08:07:16.467440 11708 ts_tablet_manager.cc:1403] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260615 08:07:16.467634 11708 raft_consensus.cc:359] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d79ad9cb87f45aca45d94809785675a" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40985 } } peers { permanent_uuid: "b56f1d19e9684785beb5b1ea2af1e08e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39981 } } peers { permanent_uuid: "4deb3a4f744645b5bb1023e008a0735f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33379 } }
I20260615 08:07:16.467712 11708 raft_consensus.cc:385] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:07:16.467763 11708 raft_consensus.cc:740] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d79ad9cb87f45aca45d94809785675a, State: Initialized, Role: FOLLOWER
I20260615 08:07:16.467832 11708 consensus_queue.cc:260] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d79ad9cb87f45aca45d94809785675a" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40985 } } peers { permanent_uuid: "b56f1d19e9684785beb5b1ea2af1e08e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39981 } } peers { permanent_uuid: "4deb3a4f744645b5bb1023e008a0735f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33379 } }
I20260615 08:07:16.468003 11708 ts_tablet_manager.cc:1434] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:16.468060 11691 heartbeater.cc:499] Master 127.4.42.254:36345 was elected leader, sending a full tablet report...
I20260615 08:07:16.614168 11714 raft_consensus.cc:493] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260615 08:07:16.614336 11714 raft_consensus.cc:515] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d79ad9cb87f45aca45d94809785675a" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40985 } } peers { permanent_uuid: "b56f1d19e9684785beb5b1ea2af1e08e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39981 } } peers { permanent_uuid: "4deb3a4f744645b5bb1023e008a0735f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33379 } }
I20260615 08:07:16.614600 11714 leader_election.cc:290] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b56f1d19e9684785beb5b1ea2af1e08e (127.4.42.194:39981), 4deb3a4f744645b5bb1023e008a0735f (127.4.42.193:33379)
I20260615 08:07:16.617920 11590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf3ba97ed764a3f91087192d093b74f" candidate_uuid: "8d79ad9cb87f45aca45d94809785675a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56f1d19e9684785beb5b1ea2af1e08e" is_pre_election: true
I20260615 08:07:16.617920 11514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf3ba97ed764a3f91087192d093b74f" candidate_uuid: "8d79ad9cb87f45aca45d94809785675a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4deb3a4f744645b5bb1023e008a0735f" is_pre_election: true
I20260615 08:07:16.618046 11514 raft_consensus.cc:2468] T caf3ba97ed764a3f91087192d093b74f P 4deb3a4f744645b5bb1023e008a0735f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d79ad9cb87f45aca45d94809785675a in term 0.
I20260615 08:07:16.618036 11590 raft_consensus.cc:2468] T caf3ba97ed764a3f91087192d093b74f P b56f1d19e9684785beb5b1ea2af1e08e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d79ad9cb87f45aca45d94809785675a in term 0.
I20260615 08:07:16.618218 11631 leader_election.cc:304] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d79ad9cb87f45aca45d94809785675a, b56f1d19e9684785beb5b1ea2af1e08e; no voters:
I20260615 08:07:16.618311 11714 raft_consensus.cc:2804] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260615 08:07:16.618352 11714 raft_consensus.cc:493] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:07:16.618371 11714 raft_consensus.cc:3060] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:07:16.619035 11714 raft_consensus.cc:515] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d79ad9cb87f45aca45d94809785675a" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40985 } } peers { permanent_uuid: "b56f1d19e9684785beb5b1ea2af1e08e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39981 } } peers { permanent_uuid: "4deb3a4f744645b5bb1023e008a0735f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33379 } }
I20260615 08:07:16.619175 11714 leader_election.cc:290] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a [CANDIDATE]: Term 1 election: Requested vote from peers b56f1d19e9684785beb5b1ea2af1e08e (127.4.42.194:39981), 4deb3a4f744645b5bb1023e008a0735f (127.4.42.193:33379)
I20260615 08:07:16.619289 11514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf3ba97ed764a3f91087192d093b74f" candidate_uuid: "8d79ad9cb87f45aca45d94809785675a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4deb3a4f744645b5bb1023e008a0735f"
I20260615 08:07:16.619290 11590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf3ba97ed764a3f91087192d093b74f" candidate_uuid: "8d79ad9cb87f45aca45d94809785675a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b56f1d19e9684785beb5b1ea2af1e08e"
I20260615 08:07:16.619370 11514 raft_consensus.cc:3060] T caf3ba97ed764a3f91087192d093b74f P 4deb3a4f744645b5bb1023e008a0735f [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:07:16.619382 11590 raft_consensus.cc:3060] T caf3ba97ed764a3f91087192d093b74f P b56f1d19e9684785beb5b1ea2af1e08e [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:07:16.620085 11590 raft_consensus.cc:2468] T caf3ba97ed764a3f91087192d093b74f P b56f1d19e9684785beb5b1ea2af1e08e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d79ad9cb87f45aca45d94809785675a in term 1.
I20260615 08:07:16.620085 11514 raft_consensus.cc:2468] T caf3ba97ed764a3f91087192d093b74f P 4deb3a4f744645b5bb1023e008a0735f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d79ad9cb87f45aca45d94809785675a in term 1.
I20260615 08:07:16.620319 11631 leader_election.cc:304] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8d79ad9cb87f45aca45d94809785675a, b56f1d19e9684785beb5b1ea2af1e08e; no voters:
I20260615 08:07:16.620440 11714 raft_consensus.cc:2804] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:07:16.620615 11714 raft_consensus.cc:697] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a [term 1 LEADER]: Becoming Leader. State: Replica: 8d79ad9cb87f45aca45d94809785675a, State: Running, Role: LEADER
I20260615 08:07:16.620683 11714 consensus_queue.cc:237] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d79ad9cb87f45aca45d94809785675a" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40985 } } peers { permanent_uuid: "b56f1d19e9684785beb5b1ea2af1e08e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39981 } } peers { permanent_uuid: "4deb3a4f744645b5bb1023e008a0735f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33379 } }
I20260615 08:07:16.621205 11410 catalog_manager.cc:5696] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d79ad9cb87f45aca45d94809785675a (127.4.42.195). New cstate: current_term: 1 leader_uuid: "8d79ad9cb87f45aca45d94809785675a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d79ad9cb87f45aca45d94809785675a" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b56f1d19e9684785beb5b1ea2af1e08e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4deb3a4f744645b5bb1023e008a0735f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33379 } health_report { overall_health: UNKNOWN } } }
I20260615 08:07:16.653033 11514 raft_consensus.cc:1275] T caf3ba97ed764a3f91087192d093b74f P 4deb3a4f744645b5bb1023e008a0735f [term 1 FOLLOWER]: Refusing update from remote peer 8d79ad9cb87f45aca45d94809785675a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:07:16.653086 11590 raft_consensus.cc:1275] T caf3ba97ed764a3f91087192d093b74f P b56f1d19e9684785beb5b1ea2af1e08e [term 1 FOLLOWER]: Refusing update from remote peer 8d79ad9cb87f45aca45d94809785675a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:07:16.653302 11714 consensus_queue.cc:1048] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4deb3a4f744645b5bb1023e008a0735f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:07:16.653529 11716 consensus_queue.cc:1048] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b56f1d19e9684785beb5b1ea2af1e08e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:07:27.176959 11765 raft_consensus.cc:993] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a: : Instructing follower 4deb3a4f744645b5bb1023e008a0735f to start an election
I20260615 08:07:27.177037 11765 raft_consensus.cc:1081] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a [term 1 LEADER]: Signalling peer 4deb3a4f744645b5bb1023e008a0735f to start an election
I20260615 08:07:27.177336 11513 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "caf3ba97ed764a3f91087192d093b74f"
dest_uuid: "4deb3a4f744645b5bb1023e008a0735f"
from {username='slave'} at 127.0.0.1:53462
I20260615 08:07:27.177421 11513 raft_consensus.cc:493] T caf3ba97ed764a3f91087192d093b74f P 4deb3a4f744645b5bb1023e008a0735f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260615 08:07:27.177443 11513 raft_consensus.cc:3060] T caf3ba97ed764a3f91087192d093b74f P 4deb3a4f744645b5bb1023e008a0735f [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:07:27.178105 11513 raft_consensus.cc:515] T caf3ba97ed764a3f91087192d093b74f P 4deb3a4f744645b5bb1023e008a0735f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d79ad9cb87f45aca45d94809785675a" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40985 } } peers { permanent_uuid: "b56f1d19e9684785beb5b1ea2af1e08e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39981 } } peers { permanent_uuid: "4deb3a4f744645b5bb1023e008a0735f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33379 } }
I20260615 08:07:27.178299 11513 leader_election.cc:290] T caf3ba97ed764a3f91087192d093b74f P 4deb3a4f744645b5bb1023e008a0735f [CANDIDATE]: Term 2 election: Requested vote from peers 8d79ad9cb87f45aca45d94809785675a (127.4.42.195:40985), b56f1d19e9684785beb5b1ea2af1e08e (127.4.42.194:39981)
I20260615 08:07:27.181106 11589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf3ba97ed764a3f91087192d093b74f" candidate_uuid: "4deb3a4f744645b5bb1023e008a0735f" candidate_term: 2 candidate_status { last_received { term: 1 index: 13705 } } ignore_live_leader: true dest_uuid: "b56f1d19e9684785beb5b1ea2af1e08e"
I20260615 08:07:27.181190 11589 raft_consensus.cc:3060] T caf3ba97ed764a3f91087192d093b74f P b56f1d19e9684785beb5b1ea2af1e08e [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:07:27.181229 11665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caf3ba97ed764a3f91087192d093b74f" candidate_uuid: "4deb3a4f744645b5bb1023e008a0735f" candidate_term: 2 candidate_status { last_received { term: 1 index: 13705 } } ignore_live_leader: true dest_uuid: "8d79ad9cb87f45aca45d94809785675a"
I20260615 08:07:27.181327 11665 raft_consensus.cc:3055] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a [term 1 LEADER]: Stepping down as leader of term 1
I20260615 08:07:27.181348 11665 raft_consensus.cc:740] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8d79ad9cb87f45aca45d94809785675a, State: Running, Role: LEADER
I20260615 08:07:27.181432 11665 consensus_queue.cc:260] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13705, Committed index: 13705, Last appended: 1.13705, Last appended by leader: 13705, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d79ad9cb87f45aca45d94809785675a" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40985 } } peers { permanent_uuid: "b56f1d19e9684785beb5b1ea2af1e08e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39981 } } peers { permanent_uuid: "4deb3a4f744645b5bb1023e008a0735f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33379 } }
I20260615 08:07:27.181546 11665 raft_consensus.cc:3060] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:07:27.181903 11589 raft_consensus.cc:2468] T caf3ba97ed764a3f91087192d093b74f P b56f1d19e9684785beb5b1ea2af1e08e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4deb3a4f744645b5bb1023e008a0735f in term 2.
I20260615 08:07:27.182124 11480 leader_election.cc:304] T caf3ba97ed764a3f91087192d093b74f P 4deb3a4f744645b5bb1023e008a0735f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4deb3a4f744645b5bb1023e008a0735f, b56f1d19e9684785beb5b1ea2af1e08e; no voters:
I20260615 08:07:27.182262 11665 raft_consensus.cc:2468] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4deb3a4f744645b5bb1023e008a0735f in term 2.
I20260615 08:07:27.182294 11771 raft_consensus.cc:2804] T caf3ba97ed764a3f91087192d093b74f P 4deb3a4f744645b5bb1023e008a0735f [term 2 FOLLOWER]: Leader election won for term 2
I20260615 08:07:27.182426 11771 raft_consensus.cc:697] T caf3ba97ed764a3f91087192d093b74f P 4deb3a4f744645b5bb1023e008a0735f [term 2 LEADER]: Becoming Leader. State: Replica: 4deb3a4f744645b5bb1023e008a0735f, State: Running, Role: LEADER
I20260615 08:07:27.182550 11771 consensus_queue.cc:237] T caf3ba97ed764a3f91087192d093b74f P 4deb3a4f744645b5bb1023e008a0735f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13705, Committed index: 13705, Last appended: 1.13705, Last appended by leader: 13705, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d79ad9cb87f45aca45d94809785675a" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40985 } } peers { permanent_uuid: "b56f1d19e9684785beb5b1ea2af1e08e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39981 } } peers { permanent_uuid: "4deb3a4f744645b5bb1023e008a0735f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33379 } }
I20260615 08:07:27.183033 11411 catalog_manager.cc:5696] T caf3ba97ed764a3f91087192d093b74f P 4deb3a4f744645b5bb1023e008a0735f reported cstate change: term changed from 1 to 2, leader changed from 8d79ad9cb87f45aca45d94809785675a (127.4.42.195) to 4deb3a4f744645b5bb1023e008a0735f (127.4.42.193). New cstate: current_term: 2 leader_uuid: "4deb3a4f744645b5bb1023e008a0735f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d79ad9cb87f45aca45d94809785675a" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b56f1d19e9684785beb5b1ea2af1e08e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4deb3a4f744645b5bb1023e008a0735f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33379 } health_report { overall_health: HEALTHY } } }
I20260615 08:07:27.189216 4267 tablet_server.cc:179] TabletServer@127.4.42.194:0 shutting down...
I20260615 08:07:27.191601 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:07:27.191716 4267 tablet_replica.cc:333] T caf3ba97ed764a3f91087192d093b74f P b56f1d19e9684785beb5b1ea2af1e08e: stopping tablet replica
I20260615 08:07:27.191767 4267 raft_consensus.cc:2243] T caf3ba97ed764a3f91087192d093b74f P b56f1d19e9684785beb5b1ea2af1e08e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260615 08:07:27.191826 4267 raft_consensus.cc:2272] T caf3ba97ed764a3f91087192d093b74f P b56f1d19e9684785beb5b1ea2af1e08e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:07:27.205421 4267 tablet_server.cc:196] TabletServer@127.4.42.194:0 shutdown complete.
I20260615 08:07:27.206259 4267 tablet_server.cc:179] TabletServer@127.4.42.195:0 shutting down...
I20260615 08:07:27.209606 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:07:27.209750 4267 tablet_replica.cc:333] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a: stopping tablet replica
I20260615 08:07:27.209816 4267 raft_consensus.cc:2243] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260615 08:07:27.209857 4267 raft_consensus.cc:2272] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:07:27.230619 4267 tablet_server.cc:196] TabletServer@127.4.42.195:0 shutdown complete.
W20260615 08:07:27.238615 11480 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.42.194:39981: connect: Connection refused (error 111)
W20260615 08:07:27.239014 11480 consensus_peers.cc:597] T caf3ba97ed764a3f91087192d093b74f P 4deb3a4f744645b5bb1023e008a0735f -> Peer b56f1d19e9684785beb5b1ea2af1e08e (127.4.42.194:39981): Couldn't send request to peer b56f1d19e9684785beb5b1ea2af1e08e. Status: Network error: Client connection negotiation failed: client connection to 127.4.42.194:39981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260615 08:07:27.239068 11480 consensus_peers.cc:597] T caf3ba97ed764a3f91087192d093b74f P 4deb3a4f744645b5bb1023e008a0735f -> Peer 8d79ad9cb87f45aca45d94809785675a (127.4.42.195:40985): Couldn't send request to peer 8d79ad9cb87f45aca45d94809785675a. Status: Network error: Client connection negotiation failed: client connection to 127.4.42.195:40985: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260615 08:07:28.236740 11778 meta_cache.cc:302] tablet caf3ba97ed764a3f91087192d093b74f: replica 4deb3a4f744645b5bb1023e008a0735f (127.4.42.193:33379) has failed: Timed out: ParticipateInTransaction RPC to 127.4.42.193:33379 timed out after 1.000s (SENT)
I20260615 08:07:28.237118 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:07:28.238283 11787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:07:28.238322 11788 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:07:28.238343 11790 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:07:28.238689 4267 server_base.cc:1061] running on GCE node
I20260615 08:07:28.238826 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:07:28.238859 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:07:28.238881 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510848238882 us; error 0 us; skew 500 ppm
I20260615 08:07:28.239477 4267 webserver.cc:533] Webserver started at http://127.4.42.194:38487/ using document root <none> and password file <none>
I20260615 08:07:28.239568 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:07:28.239604 4267 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260615 08:07:28.240172 4267 fs_manager.cc:714] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:28.240669 11795 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:28.240787 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:28.240836 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1781510637089012-4267-0/minicluster-data/ts-1-root
uuid: "b56f1d19e9684785beb5b1ea2af1e08e"
format_stamp: "Formatted at 2026-06-15 08:07:16 on dist-test-slave-37n8"
I20260615 08:07:28.240897 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1781510637089012-4267-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1781510637089012-4267-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1781510637089012-4267-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:07:28.257107 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:07:28.257315 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:07:28.257486 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:07:28.257779 11802 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260615 08:07:28.258347 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260615 08:07:28.258399 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20260615 08:07:28.258455 4267 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260615 08:07:28.258858 4267 ts_tablet_manager.cc:616] Registered 1 tablets
I20260615 08:07:28.258906 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:28.258905 11802 tablet_bootstrap.cc:492] T caf3ba97ed764a3f91087192d093b74f P b56f1d19e9684785beb5b1ea2af1e08e: Bootstrap starting.
I20260615 08:07:28.262555 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.194:39981
I20260615 08:07:28.265048 11860 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.194:39981 every 8 connection(s)
I20260615 08:07:28.269251 11861 heartbeater.cc:344] Connected to a master server at 127.4.42.254:36345
I20260615 08:07:28.269328 11861 heartbeater.cc:461] Registering TS with master...
I20260615 08:07:28.269452 11861 heartbeater.cc:507] Master 127.4.42.254:36345 requested a full tablet report, sending...
I20260615 08:07:28.269729 11411 ts_manager.cc:194] Re-registered known tserver with Master: b56f1d19e9684785beb5b1ea2af1e08e (127.4.42.194:39981)
I20260615 08:07:28.270107 11411 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50010
I20260615 08:07:29.031327 11802 tablet_bootstrap.cc:492] T caf3ba97ed764a3f91087192d093b74f P b56f1d19e9684785beb5b1ea2af1e08e: Bootstrap replayed 1/3 log segments. Stats: ops{read=4943 overwritten=0 applied=4942 ignored=0} inserts{seen=247050 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260615 08:07:29.270584 11861 heartbeater.cc:499] Master 127.4.42.254:36345 was elected leader, sending a full tablet report...
W20260615 08:07:29.793702 11480 consensus_peers.cc:597] T caf3ba97ed764a3f91087192d093b74f P 4deb3a4f744645b5bb1023e008a0735f -> Peer b56f1d19e9684785beb5b1ea2af1e08e (127.4.42.194:39981): Couldn't send request to peer b56f1d19e9684785beb5b1ea2af1e08e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260615 08:07:29.880475 11802 tablet_bootstrap.cc:492] T caf3ba97ed764a3f91087192d093b74f P b56f1d19e9684785beb5b1ea2af1e08e: Bootstrap replayed 2/3 log segments. Stats: ops{read=9873 overwritten=0 applied=9872 ignored=0} inserts{seen=493550 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
W20260615 08:07:29.889914 11480 consensus_peers.cc:597] T caf3ba97ed764a3f91087192d093b74f P 4deb3a4f744645b5bb1023e008a0735f -> Peer 8d79ad9cb87f45aca45d94809785675a (127.4.42.195:40985): Couldn't send request to peer 8d79ad9cb87f45aca45d94809785675a. Status: Network error: Client connection negotiation failed: client connection to 127.4.42.195:40985: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260615 08:07:30.557422 11802 tablet_bootstrap.cc:492] T caf3ba97ed764a3f91087192d093b74f P b56f1d19e9684785beb5b1ea2af1e08e: Bootstrap replayed 3/3 log segments. Stats: ops{read=13705 overwritten=0 applied=13705 ignored=0} inserts{seen=685200 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260615 08:07:30.557868 11802 tablet_bootstrap.cc:492] T caf3ba97ed764a3f91087192d093b74f P b56f1d19e9684785beb5b1ea2af1e08e: Bootstrap complete.
I20260615 08:07:30.562577 11802 ts_tablet_manager.cc:1403] T caf3ba97ed764a3f91087192d093b74f P b56f1d19e9684785beb5b1ea2af1e08e: Time spent bootstrapping tablet: real 2.304s user 2.022s sys 0.280s
I20260615 08:07:30.562713 11802 raft_consensus.cc:359] T caf3ba97ed764a3f91087192d093b74f P b56f1d19e9684785beb5b1ea2af1e08e [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d79ad9cb87f45aca45d94809785675a" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40985 } } peers { permanent_uuid: "b56f1d19e9684785beb5b1ea2af1e08e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39981 } } peers { permanent_uuid: "4deb3a4f744645b5bb1023e008a0735f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33379 } }
I20260615 08:07:30.562775 11802 raft_consensus.cc:740] T caf3ba97ed764a3f91087192d093b74f P b56f1d19e9684785beb5b1ea2af1e08e [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: b56f1d19e9684785beb5b1ea2af1e08e, State: Initialized, Role: FOLLOWER
I20260615 08:07:30.562842 11802 consensus_queue.cc:260] T caf3ba97ed764a3f91087192d093b74f P b56f1d19e9684785beb5b1ea2af1e08e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13705, Last appended: 1.13705, Last appended by leader: 13705, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d79ad9cb87f45aca45d94809785675a" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40985 } } peers { permanent_uuid: "b56f1d19e9684785beb5b1ea2af1e08e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39981 } } peers { permanent_uuid: "4deb3a4f744645b5bb1023e008a0735f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33379 } }
I20260615 08:07:30.563014 11802 ts_tablet_manager.cc:1434] T caf3ba97ed764a3f91087192d093b74f P b56f1d19e9684785beb5b1ea2af1e08e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:30.563257 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:07:30.564546 11876 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:07:30.564630 4267 server_base.cc:1061] running on GCE node
W20260615 08:07:30.564602 11874 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:07:30.564621 11873 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:07:30.564823 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:07:30.564884 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:07:30.564924 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510850564923 us; error 0 us; skew 500 ppm
I20260615 08:07:30.565551 4267 webserver.cc:533] Webserver started at http://127.4.42.195:39013/ using document root <none> and password file <none>
I20260615 08:07:30.565656 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:07:30.565696 4267 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260615 08:07:30.566274 4267 fs_manager.cc:714] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:30.566790 11881 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:30.566936 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:30.567018 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1781510637089012-4267-0/minicluster-data/ts-2-root
uuid: "8d79ad9cb87f45aca45d94809785675a"
format_stamp: "Formatted at 2026-06-15 08:07:16 on dist-test-slave-37n8"
I20260615 08:07:30.567066 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1781510637089012-4267-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1781510637089012-4267-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority.1781510637089012-4267-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:07:30.577195 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:07:30.577397 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:07:30.577564 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:07:30.577843 11888 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260615 08:07:30.578385 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260615 08:07:30.578439 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20260615 08:07:30.578583 4267 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260615 08:07:30.578967 4267 ts_tablet_manager.cc:616] Registered 1 tablets
I20260615 08:07:30.579010 11888 tablet_bootstrap.cc:492] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a: Bootstrap starting.
I20260615 08:07:30.579015 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260615 08:07:30.582175 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.195:40985
I20260615 08:07:30.582228 11946 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.195:40985 every 8 connection(s)
I20260615 08:07:30.585610 11947 heartbeater.cc:344] Connected to a master server at 127.4.42.254:36345
I20260615 08:07:30.585664 11947 heartbeater.cc:461] Registering TS with master...
I20260615 08:07:30.585768 11947 heartbeater.cc:507] Master 127.4.42.254:36345 requested a full tablet report, sending...
I20260615 08:07:30.586052 11411 ts_manager.cc:194] Re-registered known tserver with Master: 8d79ad9cb87f45aca45d94809785675a (127.4.42.195:40985)
I20260615 08:07:30.586429 11411 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50026
W20260615 08:07:30.931116 11956 rpcz_store.cc:267] Call kudu.tserver.TabletServerAdminService.ParticipateInTransaction from 127.0.0.1:56736 (ReqId={client: 2818ab6ac4d44a98ad0404fe47e57c37, seq_no=0, attempt_no=0}) took 3693 ms (client timeout 999 ms). Trace:
W20260615 08:07:30.931321 11956 rpcz_store.cc:269] 0615 08:07:27.238037 (+ 0us) service_pool.cc:167] Inserting onto call queue
0615 08:07:27.238057 (+ 20us) service_pool.cc:224] Handling call
0615 08:07:30.931078 (+3693021us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0615 08:07:27.238185 (+ 0us) participant_op.cc:163] PREPARE: starting
0615 08:07:27.238189 (+ 4us) participant_op.cc:199] PREPARE: finished
0615 08:07:27.238200 (+ 11us) participant_op.cc:212] START. Timestamp: 1781510847238198
0615 08:07:27.238200 (+ 0us) op_driver.cc:348] REPLICATION: starting
0615 08:07:27.238222 (+ 22us) log.cc:844] Serialized 66 byte log entry
0615 08:07:30.930818 (+3692596us) op_driver.cc:464] REPLICATION: finished
0615 08:07:30.930885 (+ 67us) participant_op.cc:265] APPLY: starting
0615 08:07:30.931058 (+ 173us) participant_op.cc:270] APPLY: finished
0615 08:07:30.931068 (+ 10us) log.cc:844] Serialized 15 byte log entry
0615 08:07:30.931071 (+ 3us) participant_op.cc:94] Released txn lock
0615 08:07:30.931072 (+ 1us) participant_op.cc:291] FINISH: Op applied
Metrics: {"child_traces":[["op",{"apply.queue_time_us":58,"prepare.queue_time_us":87,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":88,"raft.queue_time_us":72,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"replication_time_us":3692613,"spinlock_wait_cycles":23808,"thread_start_us":104,"threads_started":2}]]}
I20260615 08:07:31.304972 11888 tablet_bootstrap.cc:492] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a: Bootstrap replayed 1/3 log segments. Stats: ops{read=4622 overwritten=0 applied=4619 ignored=0} inserts{seen=230900 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 3 replicates
I20260615 08:07:31.586948 11947 heartbeater.cc:499] Master 127.4.42.254:36345 was elected leader, sending a full tablet report...
I20260615 08:07:32.091212 11888 tablet_bootstrap.cc:492] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a: Bootstrap replayed 2/3 log segments. Stats: ops{read=9242 overwritten=0 applied=9240 ignored=0} inserts{seen=461950 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates
W20260615 08:07:32.582020 11480 consensus_peers.cc:597] T caf3ba97ed764a3f91087192d093b74f P 4deb3a4f744645b5bb1023e008a0735f -> Peer 8d79ad9cb87f45aca45d94809785675a (127.4.42.195:40985): Couldn't send request to peer 8d79ad9cb87f45aca45d94809785675a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260615 08:07:32.871352 11888 tablet_bootstrap.cc:492] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a: Bootstrap replayed 3/3 log segments. Stats: ops{read=13705 overwritten=0 applied=13705 ignored=0} inserts{seen=685200 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260615 08:07:32.871876 11888 tablet_bootstrap.cc:492] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a: Bootstrap complete.
I20260615 08:07:32.876967 11888 ts_tablet_manager.cc:1403] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a: Time spent bootstrapping tablet: real 2.298s user 1.963s sys 0.332s
I20260615 08:07:32.877163 11888 raft_consensus.cc:359] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d79ad9cb87f45aca45d94809785675a" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40985 } } peers { permanent_uuid: "b56f1d19e9684785beb5b1ea2af1e08e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39981 } } peers { permanent_uuid: "4deb3a4f744645b5bb1023e008a0735f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33379 } }
I20260615 08:07:32.877236 11888 raft_consensus.cc:740] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d79ad9cb87f45aca45d94809785675a, State: Initialized, Role: FOLLOWER
I20260615 08:07:32.877298 11888 consensus_queue.cc:260] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13705, Last appended: 1.13705, Last appended by leader: 13705, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8d79ad9cb87f45aca45d94809785675a" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40985 } } peers { permanent_uuid: "b56f1d19e9684785beb5b1ea2af1e08e" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39981 } } peers { permanent_uuid: "4deb3a4f744645b5bb1023e008a0735f" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 33379 } }
I20260615 08:07:32.877465 11888 ts_tablet_manager.cc:1434] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a: Time spent starting tablet: real 0.000s user 0.002s sys 0.000s
I20260615 08:07:33.133963 4267 tablet_server.cc:179] TabletServer@127.4.42.193:0 shutting down...
I20260615 08:07:33.136693 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:07:33.136839 4267 tablet_replica.cc:333] T caf3ba97ed764a3f91087192d093b74f P 4deb3a4f744645b5bb1023e008a0735f: stopping tablet replica
I20260615 08:07:33.136899 4267 raft_consensus.cc:2243] T caf3ba97ed764a3f91087192d093b74f P 4deb3a4f744645b5bb1023e008a0735f [term 2 LEADER]: Raft consensus shutting down.
I20260615 08:07:33.136979 4267 raft_consensus.cc:2272] T caf3ba97ed764a3f91087192d093b74f P 4deb3a4f744645b5bb1023e008a0735f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:07:33.151718 4267 tablet_server.cc:196] TabletServer@127.4.42.193:0 shutdown complete.
I20260615 08:07:33.152571 4267 tablet_server.cc:179] TabletServer@127.4.42.194:39981 shutting down...
I20260615 08:07:33.155049 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:07:33.155208 4267 tablet_replica.cc:333] stopping tablet replica
I20260615 08:07:33.155272 4267 raft_consensus.cc:2243] T caf3ba97ed764a3f91087192d093b74f P b56f1d19e9684785beb5b1ea2af1e08e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260615 08:07:33.155352 4267 raft_consensus.cc:2272] T caf3ba97ed764a3f91087192d093b74f P b56f1d19e9684785beb5b1ea2af1e08e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:07:33.175439 4267 tablet_server.cc:196] TabletServer@127.4.42.194:39981 shutdown complete.
I20260615 08:07:33.176257 4267 tablet_server.cc:179] TabletServer@127.4.42.195:40985 shutting down...
I20260615 08:07:33.178875 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:07:33.179075 4267 tablet_replica.cc:333] stopping tablet replica
I20260615 08:07:33.179148 4267 raft_consensus.cc:2243] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260615 08:07:33.179203 4267 raft_consensus.cc:2272] T caf3ba97ed764a3f91087192d093b74f P 8d79ad9cb87f45aca45d94809785675a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:07:33.192373 4267 tablet_server.cc:196] TabletServer@127.4.42.195:40985 shutdown complete.
I20260615 08:07:33.193202 4267 master.cc:562] Master@127.4.42.254:36345 shutting down...
I20260615 08:07:33.195935 4267 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 99037bdd3c4d477ba0fcd16128749fb7 [term 1 LEADER]: Raft consensus shutting down.
I20260615 08:07:33.196009 4267 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 99037bdd3c4d477ba0fcd16128749fb7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:07:33.196049 4267 tablet_replica.cc:333] T 00000000000000000000000000000000 P 99037bdd3c4d477ba0fcd16128749fb7: stopping tablet replica
I20260615 08:07:33.207648 4267 master.cc:584] Master@127.4.42.254:36345 shutdown complete.
[ OK ] TxnParticipantITest.TestTxnSystemClientTimeoutWhenNoMajority (16877 ms)
[ RUN ] TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap
I20260615 08:07:33.227239 4267 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.42.254:37493
I20260615 08:07:33.227447 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:07:33.228672 11969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:07:33.228705 11968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:07:33.228860 4267 server_base.cc:1061] running on GCE node
W20260615 08:07:33.228680 11971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:07:33.229046 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:07:33.229084 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:07:33.229097 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510853229097 us; error 0 us; skew 500 ppm
I20260615 08:07:33.229642 4267 webserver.cc:533] Webserver started at http://127.4.42.254:33615/ using document root <none> and password file <none>
I20260615 08:07:33.229710 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:07:33.229746 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:07:33.229780 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:07:33.230015 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1781510637089012-4267-0/minicluster-data/master-0-root/instance:
uuid: "25565b9579814577837c33af136ed18a"
format_stamp: "Formatted at 2026-06-15 08:07:33 on dist-test-slave-37n8"
I20260615 08:07:33.230890 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:07:33.231273 11976 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:33.231415 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:33.231477 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1781510637089012-4267-0/minicluster-data/master-0-root
uuid: "25565b9579814577837c33af136ed18a"
format_stamp: "Formatted at 2026-06-15 08:07:33 on dist-test-slave-37n8"
I20260615 08:07:33.231544 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1781510637089012-4267-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1781510637089012-4267-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1781510637089012-4267-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:07:33.246714 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:07:33.246937 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:07:33.249346 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.254:37493
I20260615 08:07:33.256088 12028 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.254:37493 every 8 connection(s)
I20260615 08:07:33.261427 12029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:07:33.262466 12029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25565b9579814577837c33af136ed18a: Bootstrap starting.
I20260615 08:07:33.262826 12029 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 25565b9579814577837c33af136ed18a: Neither blocks nor log segments found. Creating new log.
I20260615 08:07:33.263412 12029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25565b9579814577837c33af136ed18a: No bootstrap required, opened a new log
I20260615 08:07:33.263554 12029 raft_consensus.cc:359] T 00000000000000000000000000000000 P 25565b9579814577837c33af136ed18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25565b9579814577837c33af136ed18a" member_type: VOTER }
I20260615 08:07:33.263602 12029 raft_consensus.cc:385] T 00000000000000000000000000000000 P 25565b9579814577837c33af136ed18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:07:33.263616 12029 raft_consensus.cc:740] T 00000000000000000000000000000000 P 25565b9579814577837c33af136ed18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25565b9579814577837c33af136ed18a, State: Initialized, Role: FOLLOWER
I20260615 08:07:33.263681 12029 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25565b9579814577837c33af136ed18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25565b9579814577837c33af136ed18a" member_type: VOTER }
I20260615 08:07:33.263720 12029 raft_consensus.cc:399] T 00000000000000000000000000000000 P 25565b9579814577837c33af136ed18a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260615 08:07:33.263759 12029 raft_consensus.cc:493] T 00000000000000000000000000000000 P 25565b9579814577837c33af136ed18a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260615 08:07:33.263788 12029 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 25565b9579814577837c33af136ed18a [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:07:33.264264 12029 raft_consensus.cc:515] T 00000000000000000000000000000000 P 25565b9579814577837c33af136ed18a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25565b9579814577837c33af136ed18a" member_type: VOTER }
I20260615 08:07:33.264318 12029 leader_election.cc:304] T 00000000000000000000000000000000 P 25565b9579814577837c33af136ed18a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 25565b9579814577837c33af136ed18a; no voters:
I20260615 08:07:33.264441 12029 leader_election.cc:290] T 00000000000000000000000000000000 P 25565b9579814577837c33af136ed18a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260615 08:07:33.264523 12032 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 25565b9579814577837c33af136ed18a [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:07:33.264595 12029 sys_catalog.cc:565] T 00000000000000000000000000000000 P 25565b9579814577837c33af136ed18a [sys.catalog]: configured and running, proceeding with master startup.
I20260615 08:07:33.264654 12032 raft_consensus.cc:697] T 00000000000000000000000000000000 P 25565b9579814577837c33af136ed18a [term 1 LEADER]: Becoming Leader. State: Replica: 25565b9579814577837c33af136ed18a, State: Running, Role: LEADER
I20260615 08:07:33.264706 12032 consensus_queue.cc:237] T 00000000000000000000000000000000 P 25565b9579814577837c33af136ed18a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25565b9579814577837c33af136ed18a" member_type: VOTER }
I20260615 08:07:33.264952 12034 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25565b9579814577837c33af136ed18a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 25565b9579814577837c33af136ed18a. Latest consensus state: current_term: 1 leader_uuid: "25565b9579814577837c33af136ed18a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25565b9579814577837c33af136ed18a" member_type: VOTER } }
I20260615 08:07:33.265055 12034 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25565b9579814577837c33af136ed18a [sys.catalog]: This master's current role is: LEADER
I20260615 08:07:33.265194 12033 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25565b9579814577837c33af136ed18a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "25565b9579814577837c33af136ed18a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25565b9579814577837c33af136ed18a" member_type: VOTER } }
I20260615 08:07:33.265277 12033 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25565b9579814577837c33af136ed18a [sys.catalog]: This master's current role is: LEADER
I20260615 08:07:33.265388 12038 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260615 08:07:33.265535 12038 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260615 08:07:33.266002 4267 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260615 08:07:33.266146 12038 catalog_manager.cc:1382] Generated new cluster ID: eeb86bd0a3a84a1bafd1a4f6b10fb9e9
I20260615 08:07:33.266181 12038 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260615 08:07:33.273622 12038 catalog_manager.cc:1405] Generated new certificate authority record
I20260615 08:07:33.274040 12038 catalog_manager.cc:1539] Loading token signing keys...
I20260615 08:07:33.279812 12038 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 25565b9579814577837c33af136ed18a: Generated new TSK 0
I20260615 08:07:33.279876 12038 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260615 08:07:33.281606 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:07:33.282859 12050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:07:33.282977 4267 server_base.cc:1061] running on GCE node
W20260615 08:07:33.282949 12051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:07:33.283098 12053 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:07:33.283257 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:07:33.283290 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:07:33.283303 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510853283304 us; error 0 us; skew 500 ppm
I20260615 08:07:33.283843 4267 webserver.cc:533] Webserver started at http://127.4.42.193:35543/ using document root <none> and password file <none>
I20260615 08:07:33.283946 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:07:33.283999 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:07:33.284045 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:07:33.284312 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1781510637089012-4267-0/minicluster-data/ts-0-root/instance:
uuid: "0b8c8398fb4c416380f0d3cf94a253ca"
format_stamp: "Formatted at 2026-06-15 08:07:33 on dist-test-slave-37n8"
I20260615 08:07:33.285229 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:07:33.285655 12058 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:33.285773 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:33.285817 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1781510637089012-4267-0/minicluster-data/ts-0-root
uuid: "0b8c8398fb4c416380f0d3cf94a253ca"
format_stamp: "Formatted at 2026-06-15 08:07:33 on dist-test-slave-37n8"
I20260615 08:07:33.285862 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1781510637089012-4267-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1781510637089012-4267-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1781510637089012-4267-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:07:33.309514 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:07:33.309682 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:07:33.309792 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:07:33.309999 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:07:33.310027 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:33.310081 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:07:33.310108 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:33.313077 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.193:41713
I20260615 08:07:33.313102 12121 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.193:41713 every 8 connection(s)
I20260615 08:07:33.313453 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:07:33.314457 12126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:07:33.314638 12127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:07:33.314707 4267 server_base.cc:1061] running on GCE node
W20260615 08:07:33.314844 12129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:07:33.315001 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:07:33.315042 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:07:33.315053 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510853315054 us; error 0 us; skew 500 ppm
I20260615 08:07:33.315649 4267 webserver.cc:533] Webserver started at http://127.4.42.194:32819/ using document root <none> and password file <none>
I20260615 08:07:33.315749 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:07:33.315797 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:07:33.315843 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:07:33.316107 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1781510637089012-4267-0/minicluster-data/ts-1-root/instance:
uuid: "f9f6827b0f684080a6766793288630ef"
format_stamp: "Formatted at 2026-06-15 08:07:33 on dist-test-slave-37n8"
I20260615 08:07:33.317090 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:07:33.317523 12134 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:33.317652 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:33.317708 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1781510637089012-4267-0/minicluster-data/ts-1-root
uuid: "f9f6827b0f684080a6766793288630ef"
format_stamp: "Formatted at 2026-06-15 08:07:33 on dist-test-slave-37n8"
I20260615 08:07:33.317754 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1781510637089012-4267-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1781510637089012-4267-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1781510637089012-4267-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:07:33.321216 12122 heartbeater.cc:344] Connected to a master server at 127.4.42.254:37493
I20260615 08:07:33.321283 12122 heartbeater.cc:461] Registering TS with master...
I20260615 08:07:33.321408 12122 heartbeater.cc:507] Master 127.4.42.254:37493 requested a full tablet report, sending...
I20260615 08:07:33.321672 11993 ts_manager.cc:194] Registered new tserver with Master: 0b8c8398fb4c416380f0d3cf94a253ca (127.4.42.193:41713)
I20260615 08:07:33.322211 11993 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58834
I20260615 08:07:33.336855 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:07:33.337065 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:07:33.337230 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:07:33.337421 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:07:33.337467 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:33.337512 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:07:33.337539 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:33.340261 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.194:39381
I20260615 08:07:33.340327 12197 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.194:39381 every 8 connection(s)
I20260615 08:07:33.340651 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:07:33.341785 12202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:07:33.341960 12204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:07:33.342412 12201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:07:33.342906 4267 server_base.cc:1061] running on GCE node
I20260615 08:07:33.343020 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:07:33.343045 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:07:33.343058 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510853343058 us; error 0 us; skew 500 ppm
I20260615 08:07:33.343644 4267 webserver.cc:533] Webserver started at http://127.4.42.195:38913/ using document root <none> and password file <none>
I20260615 08:07:33.343734 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:07:33.343783 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:07:33.343796 12198 heartbeater.cc:344] Connected to a master server at 127.4.42.254:37493
I20260615 08:07:33.343833 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:07:33.343865 12198 heartbeater.cc:461] Registering TS with master...
I20260615 08:07:33.343981 12198 heartbeater.cc:507] Master 127.4.42.254:37493 requested a full tablet report, sending...
I20260615 08:07:33.344203 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1781510637089012-4267-0/minicluster-data/ts-2-root/instance:
uuid: "28354b9214c24d5f8d12f12b8f9f7aad"
format_stamp: "Formatted at 2026-06-15 08:07:33 on dist-test-slave-37n8"
I20260615 08:07:33.344234 11993 ts_manager.cc:194] Registered new tserver with Master: f9f6827b0f684080a6766793288630ef (127.4.42.194:39381)
I20260615 08:07:33.344705 11993 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58842
I20260615 08:07:33.345229 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260615 08:07:33.345625 12209 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:33.345765 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:33.345834 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1781510637089012-4267-0/minicluster-data/ts-2-root
uuid: "28354b9214c24d5f8d12f12b8f9f7aad"
format_stamp: "Formatted at 2026-06-15 08:07:33 on dist-test-slave-37n8"
I20260615 08:07:33.345894 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1781510637089012-4267-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1781510637089012-4267-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1781510637089012-4267-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:07:33.360554 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:07:33.360762 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:07:33.360942 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:07:33.361141 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:07:33.361193 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:33.361233 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:07:33.361263 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:33.364460 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.195:43035
I20260615 08:07:33.364518 12272 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.195:43035 every 8 connection(s)
I20260615 08:07:33.367486 12273 heartbeater.cc:344] Connected to a master server at 127.4.42.254:37493
I20260615 08:07:33.367547 12273 heartbeater.cc:461] Registering TS with master...
I20260615 08:07:33.367647 12273 heartbeater.cc:507] Master 127.4.42.254:37493 requested a full tablet report, sending...
I20260615 08:07:33.367878 11993 ts_manager.cc:194] Registered new tserver with Master: 28354b9214c24d5f8d12f12b8f9f7aad (127.4.42.195:43035)
I20260615 08:07:33.367992 4267 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003306857s
I20260615 08:07:33.368341 11993 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58844
I20260615 08:07:33.372925 11993 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58854:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260615 08:07:33.373095 11993 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260615 08:07:33.377746 12086 tablet_service.cc:1511] Processing CreateTablet for tablet 71f14099c6f843688e20cefda6479892 (DEFAULT_TABLE table=test-workload [id=52036841c91144fbb125dd4bb45a8452]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:07:33.377868 12086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71f14099c6f843688e20cefda6479892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:07:33.378007 12237 tablet_service.cc:1511] Processing CreateTablet for tablet 71f14099c6f843688e20cefda6479892 (DEFAULT_TABLE table=test-workload [id=52036841c91144fbb125dd4bb45a8452]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:07:33.378083 12237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71f14099c6f843688e20cefda6479892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:07:33.378732 12162 tablet_service.cc:1511] Processing CreateTablet for tablet 71f14099c6f843688e20cefda6479892 (DEFAULT_TABLE table=test-workload [id=52036841c91144fbb125dd4bb45a8452]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:07:33.378818 12162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71f14099c6f843688e20cefda6479892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:07:33.379508 12288 tablet_bootstrap.cc:492] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca: Bootstrap starting.
I20260615 08:07:33.379944 12288 tablet_bootstrap.cc:654] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca: Neither blocks nor log segments found. Creating new log.
I20260615 08:07:33.380312 12289 tablet_bootstrap.cc:492] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad: Bootstrap starting.
I20260615 08:07:33.380676 12288 tablet_bootstrap.cc:492] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca: No bootstrap required, opened a new log
I20260615 08:07:33.380689 12289 tablet_bootstrap.cc:654] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad: Neither blocks nor log segments found. Creating new log.
I20260615 08:07:33.380719 12288 ts_tablet_manager.cc:1403] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:07:33.380882 12288 raft_consensus.cc:359] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41713 } } peers { permanent_uuid: "f9f6827b0f684080a6766793288630ef" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39381 } } peers { permanent_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43035 } }
I20260615 08:07:33.380934 12288 raft_consensus.cc:385] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:07:33.380947 12288 raft_consensus.cc:740] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b8c8398fb4c416380f0d3cf94a253ca, State: Initialized, Role: FOLLOWER
I20260615 08:07:33.381006 12288 consensus_queue.cc:260] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41713 } } peers { permanent_uuid: "f9f6827b0f684080a6766793288630ef" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39381 } } peers { permanent_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43035 } }
I20260615 08:07:33.381062 12290 tablet_bootstrap.cc:492] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef: Bootstrap starting.
I20260615 08:07:33.381204 12288 ts_tablet_manager.cc:1434] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260615 08:07:33.381222 12122 heartbeater.cc:499] Master 127.4.42.254:37493 was elected leader, sending a full tablet report...
I20260615 08:07:33.381259 12289 tablet_bootstrap.cc:492] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad: No bootstrap required, opened a new log
I20260615 08:07:33.381449 12289 ts_tablet_manager.cc:1403] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:07:33.381603 12289 raft_consensus.cc:359] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41713 } } peers { permanent_uuid: "f9f6827b0f684080a6766793288630ef" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39381 } } peers { permanent_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43035 } }
I20260615 08:07:33.381670 12289 raft_consensus.cc:385] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:07:33.381717 12289 raft_consensus.cc:740] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28354b9214c24d5f8d12f12b8f9f7aad, State: Initialized, Role: FOLLOWER
I20260615 08:07:33.381732 12290 tablet_bootstrap.cc:654] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef: Neither blocks nor log segments found. Creating new log.
I20260615 08:07:33.381886 12289 consensus_queue.cc:260] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41713 } } peers { permanent_uuid: "f9f6827b0f684080a6766793288630ef" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39381 } } peers { permanent_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43035 } }
I20260615 08:07:33.382043 12289 ts_tablet_manager.cc:1434] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260615 08:07:33.382119 12273 heartbeater.cc:499] Master 127.4.42.254:37493 was elected leader, sending a full tablet report...
I20260615 08:07:33.382597 12290 tablet_bootstrap.cc:492] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef: No bootstrap required, opened a new log
I20260615 08:07:33.382650 12290 ts_tablet_manager.cc:1403] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260615 08:07:33.382848 12290 raft_consensus.cc:359] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41713 } } peers { permanent_uuid: "f9f6827b0f684080a6766793288630ef" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39381 } } peers { permanent_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43035 } }
I20260615 08:07:33.382923 12290 raft_consensus.cc:385] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:07:33.382972 12290 raft_consensus.cc:740] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9f6827b0f684080a6766793288630ef, State: Initialized, Role: FOLLOWER
I20260615 08:07:33.383036 12290 consensus_queue.cc:260] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41713 } } peers { permanent_uuid: "f9f6827b0f684080a6766793288630ef" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39381 } } peers { permanent_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43035 } }
I20260615 08:07:33.383195 12290 ts_tablet_manager.cc:1434] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:33.383261 12198 heartbeater.cc:499] Master 127.4.42.254:37493 was elected leader, sending a full tablet report...
W20260615 08:07:33.563467 12123 tablet.cc:2404] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260615 08:07:33.661621 12296 raft_consensus.cc:493] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260615 08:07:33.661728 12296 raft_consensus.cc:515] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41713 } } peers { permanent_uuid: "f9f6827b0f684080a6766793288630ef" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39381 } } peers { permanent_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43035 } }
I20260615 08:07:33.661947 12296 leader_election.cc:290] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0b8c8398fb4c416380f0d3cf94a253ca (127.4.42.193:41713), 28354b9214c24d5f8d12f12b8f9f7aad (127.4.42.195:43035)
I20260615 08:07:33.664536 12247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f14099c6f843688e20cefda6479892" candidate_uuid: "f9f6827b0f684080a6766793288630ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" is_pre_election: true
I20260615 08:07:33.664641 12247 raft_consensus.cc:2468] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9f6827b0f684080a6766793288630ef in term 0.
I20260615 08:07:33.664717 12096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f14099c6f843688e20cefda6479892" candidate_uuid: "f9f6827b0f684080a6766793288630ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" is_pre_election: true
I20260615 08:07:33.664817 12096 raft_consensus.cc:2468] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9f6827b0f684080a6766793288630ef in term 0.
I20260615 08:07:33.664857 12138 leader_election.cc:304] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28354b9214c24d5f8d12f12b8f9f7aad, f9f6827b0f684080a6766793288630ef; no voters:
I20260615 08:07:33.664989 12296 raft_consensus.cc:2804] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260615 08:07:33.665025 12296 raft_consensus.cc:493] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:07:33.665057 12296 raft_consensus.cc:3060] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:07:33.665684 12296 raft_consensus.cc:515] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41713 } } peers { permanent_uuid: "f9f6827b0f684080a6766793288630ef" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39381 } } peers { permanent_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43035 } }
I20260615 08:07:33.665827 12296 leader_election.cc:290] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [CANDIDATE]: Term 1 election: Requested vote from peers 0b8c8398fb4c416380f0d3cf94a253ca (127.4.42.193:41713), 28354b9214c24d5f8d12f12b8f9f7aad (127.4.42.195:43035)
I20260615 08:07:33.665961 12247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f14099c6f843688e20cefda6479892" candidate_uuid: "f9f6827b0f684080a6766793288630ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28354b9214c24d5f8d12f12b8f9f7aad"
I20260615 08:07:33.665974 12096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f14099c6f843688e20cefda6479892" candidate_uuid: "f9f6827b0f684080a6766793288630ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b8c8398fb4c416380f0d3cf94a253ca"
I20260615 08:07:33.666050 12247 raft_consensus.cc:3060] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:07:33.666059 12096 raft_consensus.cc:3060] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:07:33.666829 12096 raft_consensus.cc:2468] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9f6827b0f684080a6766793288630ef in term 1.
I20260615 08:07:33.666867 12247 raft_consensus.cc:2468] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9f6827b0f684080a6766793288630ef in term 1.
I20260615 08:07:33.667060 12135 leader_election.cc:304] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b8c8398fb4c416380f0d3cf94a253ca, f9f6827b0f684080a6766793288630ef; no voters:
I20260615 08:07:33.667200 12296 raft_consensus.cc:2804] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:07:33.667371 12296 raft_consensus.cc:697] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [term 1 LEADER]: Becoming Leader. State: Replica: f9f6827b0f684080a6766793288630ef, State: Running, Role: LEADER
I20260615 08:07:33.667447 12296 consensus_queue.cc:237] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41713 } } peers { permanent_uuid: "f9f6827b0f684080a6766793288630ef" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39381 } } peers { permanent_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43035 } }
I20260615 08:07:33.668045 11992 catalog_manager.cc:5696] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef reported cstate change: term changed from 0 to 1, leader changed from <none> to f9f6827b0f684080a6766793288630ef (127.4.42.194). New cstate: current_term: 1 leader_uuid: "f9f6827b0f684080a6766793288630ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9f6827b0f684080a6766793288630ef" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43035 } health_report { overall_health: UNKNOWN } } }
I20260615 08:07:33.738906 12096 raft_consensus.cc:1275] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [term 1 FOLLOWER]: Refusing update from remote peer f9f6827b0f684080a6766793288630ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:07:33.738907 12247 raft_consensus.cc:1275] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad [term 1 FOLLOWER]: Refusing update from remote peer f9f6827b0f684080a6766793288630ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:07:33.739151 12296 consensus_queue.cc:1048] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:07:33.739287 12298 consensus_queue.cc:1048] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:07:44.260252 12344 raft_consensus.cc:993] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef: : Instructing follower 0b8c8398fb4c416380f0d3cf94a253ca to start an election
I20260615 08:07:44.260335 12344 raft_consensus.cc:1081] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [term 1 LEADER]: Signalling peer 0b8c8398fb4c416380f0d3cf94a253ca to start an election
I20260615 08:07:44.260576 12095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71f14099c6f843688e20cefda6479892"
dest_uuid: "0b8c8398fb4c416380f0d3cf94a253ca"
from {username='slave'} at 127.0.0.1:54944
I20260615 08:07:44.260658 12095 raft_consensus.cc:493] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260615 08:07:44.260679 12095 raft_consensus.cc:3060] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:07:44.261575 12095 raft_consensus.cc:515] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41713 } } peers { permanent_uuid: "f9f6827b0f684080a6766793288630ef" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39381 } } peers { permanent_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43035 } }
I20260615 08:07:44.261781 12095 leader_election.cc:290] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [CANDIDATE]: Term 2 election: Requested vote from peers f9f6827b0f684080a6766793288630ef (127.4.42.194:39381), 28354b9214c24d5f8d12f12b8f9f7aad (127.4.42.195:43035)
I20260615 08:07:44.264411 12172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f14099c6f843688e20cefda6479892" candidate_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 13589 } } ignore_live_leader: true dest_uuid: "f9f6827b0f684080a6766793288630ef"
I20260615 08:07:44.264496 12172 raft_consensus.cc:3055] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [term 1 LEADER]: Stepping down as leader of term 1
I20260615 08:07:44.264531 12172 raft_consensus.cc:740] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f9f6827b0f684080a6766793288630ef, State: Running, Role: LEADER
I20260615 08:07:44.264526 12246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f14099c6f843688e20cefda6479892" candidate_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" candidate_term: 2 candidate_status { last_received { term: 1 index: 13589 } } ignore_live_leader: true dest_uuid: "28354b9214c24d5f8d12f12b8f9f7aad"
I20260615 08:07:44.264645 12246 raft_consensus.cc:3060] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:07:44.264652 12172 consensus_queue.cc:260] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13589, Committed index: 13589, Last appended: 1.13589, Last appended by leader: 13589, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41713 } } peers { permanent_uuid: "f9f6827b0f684080a6766793288630ef" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39381 } } peers { permanent_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43035 } }
I20260615 08:07:44.264811 12172 raft_consensus.cc:3060] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:07:44.265393 12246 raft_consensus.cc:2468] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b8c8398fb4c416380f0d3cf94a253ca in term 2.
I20260615 08:07:44.265543 12172 raft_consensus.cc:2468] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b8c8398fb4c416380f0d3cf94a253ca in term 2.
I20260615 08:07:44.265550 12062 leader_election.cc:304] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b8c8398fb4c416380f0d3cf94a253ca, 28354b9214c24d5f8d12f12b8f9f7aad; no voters:
I20260615 08:07:44.265776 12350 raft_consensus.cc:2804] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [term 2 FOLLOWER]: Leader election won for term 2
I20260615 08:07:44.265910 12350 raft_consensus.cc:697] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [term 2 LEADER]: Becoming Leader. State: Replica: 0b8c8398fb4c416380f0d3cf94a253ca, State: Running, Role: LEADER
I20260615 08:07:44.265996 12350 consensus_queue.cc:237] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13589, Committed index: 13589, Last appended: 1.13589, Last appended by leader: 13589, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41713 } } peers { permanent_uuid: "f9f6827b0f684080a6766793288630ef" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39381 } } peers { permanent_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43035 } }
I20260615 08:07:44.266522 11988 catalog_manager.cc:5696] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca reported cstate change: term changed from 1 to 2, leader changed from f9f6827b0f684080a6766793288630ef (127.4.42.194) to 0b8c8398fb4c416380f0d3cf94a253ca (127.4.42.193). New cstate: current_term: 2 leader_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9f6827b0f684080a6766793288630ef" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43035 } health_report { overall_health: UNKNOWN } } }
I20260615 08:07:44.275955 4267 tablet_server.cc:179] TabletServer@127.4.42.193:0 shutting down...
I20260615 08:07:44.279353 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:07:44.279456 4267 tablet_replica.cc:333] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca: stopping tablet replica
I20260615 08:07:44.279517 4267 raft_consensus.cc:2243] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [term 2 LEADER]: Raft consensus shutting down.
I20260615 08:07:44.279592 4267 pending_rounds.cc:70] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca: Trying to abort 1 pending ops.
I20260615 08:07:44.279628 4267 pending_rounds.cc:77] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca: Aborting op as it isn't in flight: id { term: 2 index: 13590 } timestamp: 7297068500034174976 op_type: NO_OP noop_request { }
I20260615 08:07:44.279687 4267 raft_consensus.cc:2889] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260615 08:07:44.279714 4267 raft_consensus.cc:2272] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [term 2 FOLLOWER]: Raft consensus is shut down!
W20260615 08:07:44.284888 12356 meta_cache.cc:302] tablet 71f14099c6f843688e20cefda6479892: replica 0b8c8398fb4c416380f0d3cf94a253ca (127.4.42.193:41713) has failed: Network error: Client connection negotiation failed: client connection to 127.4.42.193:41713: connect: Connection refused (error 111)
W20260615 08:07:44.289062 12162 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34950: Illegal state: replica f9f6827b0f684080a6766793288630ef is not leader of this config: current role FOLLOWER
I20260615 08:07:44.293443 4267 tablet_server.cc:196] TabletServer@127.4.42.193:0 shutdown complete.
I20260615 08:07:44.294361 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:07:44.294677 12237 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46442: Illegal state: replica 28354b9214c24d5f8d12f12b8f9f7aad is not leader of this config: current role FOLLOWER
W20260615 08:07:44.295924 12365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:07:44.296025 4267 server_base.cc:1061] running on GCE node
W20260615 08:07:44.296025 12366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:07:44.296109 12368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:07:44.296303 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:07:44.296355 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:07:44.296377 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510864296376 us; error 0 us; skew 500 ppm
I20260615 08:07:44.296909 4267 webserver.cc:533] Webserver started at http://127.4.42.193:35543/ using document root <none> and password file <none>
I20260615 08:07:44.297021 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:07:44.297060 4267 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260615 08:07:44.297581 4267 fs_manager.cc:714] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:44.298028 12373 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:44.298154 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:44.298216 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1781510637089012-4267-0/minicluster-data/ts-0-root
uuid: "0b8c8398fb4c416380f0d3cf94a253ca"
format_stamp: "Formatted at 2026-06-15 08:07:33 on dist-test-slave-37n8"
I20260615 08:07:44.298266 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1781510637089012-4267-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1781510637089012-4267-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1781510637089012-4267-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:07:44.305622 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:07:44.305814 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:07:44.305955 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:07:44.306218 12380 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260615 08:07:44.306841 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260615 08:07:44.306895 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20260615 08:07:44.306932 4267 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260615 08:07:44.307310 4267 ts_tablet_manager.cc:616] Registered 1 tablets
I20260615 08:07:44.307355 12380 tablet_bootstrap.cc:492] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca: Bootstrap starting.
I20260615 08:07:44.307359 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:44.310875 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.193:41713
W20260615 08:07:44.312907 12162 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34950: Illegal state: replica f9f6827b0f684080a6766793288630ef is not leader of this config: current role FOLLOWER
I20260615 08:07:44.317013 12438 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.193:41713 every 8 connection(s)
W20260615 08:07:44.319348 12237 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46442: Illegal state: replica 28354b9214c24d5f8d12f12b8f9f7aad is not leader of this config: current role FOLLOWER
I20260615 08:07:44.325390 12439 heartbeater.cc:344] Connected to a master server at 127.4.42.254:37493
I20260615 08:07:44.325469 12439 heartbeater.cc:461] Registering TS with master...
I20260615 08:07:44.325579 12439 heartbeater.cc:507] Master 127.4.42.254:37493 requested a full tablet report, sending...
I20260615 08:07:44.325853 11988 ts_manager.cc:194] Re-registered known tserver with Master: 0b8c8398fb4c416380f0d3cf94a253ca (127.4.42.193:41713)
I20260615 08:07:44.326337 11988 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53374
I20260615 08:07:45.103468 12380 tablet_bootstrap.cc:492] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca: Bootstrap replayed 1/3 log segments. Stats: ops{read=4941 overwritten=0 applied=4938 ignored=0} inserts{seen=246850 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 3 replicates
I20260615 08:07:45.326927 12439 heartbeater.cc:499] Master 127.4.42.254:37493 was elected leader, sending a full tablet report...
I20260615 08:07:45.912222 12445 raft_consensus.cc:493] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260615 08:07:45.912339 12445 raft_consensus.cc:515] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41713 } } peers { permanent_uuid: "f9f6827b0f684080a6766793288630ef" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39381 } } peers { permanent_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43035 } }
I20260615 08:07:45.913100 12445 leader_election.cc:290] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0b8c8398fb4c416380f0d3cf94a253ca (127.4.42.193:41713), f9f6827b0f684080a6766793288630ef (127.4.42.194:39381)
I20260615 08:07:45.916654 12413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f14099c6f843688e20cefda6479892" candidate_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" candidate_term: 3 candidate_status { last_received { term: 1 index: 13589 } } ignore_live_leader: false dest_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" is_pre_election: true
W20260615 08:07:45.916976 12210 leader_election.cc:343] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 0b8c8398fb4c416380f0d3cf94a253ca (127.4.42.193:41713): Illegal state: must be running to vote when last-logged opid is not known
I20260615 08:07:45.918159 12172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f14099c6f843688e20cefda6479892" candidate_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" candidate_term: 3 candidate_status { last_received { term: 1 index: 13589 } } ignore_live_leader: false dest_uuid: "f9f6827b0f684080a6766793288630ef" is_pre_election: true
I20260615 08:07:45.918262 12172 raft_consensus.cc:2468] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28354b9214c24d5f8d12f12b8f9f7aad in term 2.
I20260615 08:07:45.918413 12211 leader_election.cc:304] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 28354b9214c24d5f8d12f12b8f9f7aad, f9f6827b0f684080a6766793288630ef; no voters: 0b8c8398fb4c416380f0d3cf94a253ca
I20260615 08:07:45.918555 12445 raft_consensus.cc:2804] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260615 08:07:45.918618 12445 raft_consensus.cc:493] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:07:45.918677 12445 raft_consensus.cc:3060] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad [term 2 FOLLOWER]: Advancing to term 3
I20260615 08:07:45.919549 12445 raft_consensus.cc:515] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41713 } } peers { permanent_uuid: "f9f6827b0f684080a6766793288630ef" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39381 } } peers { permanent_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43035 } }
I20260615 08:07:45.919802 12413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f14099c6f843688e20cefda6479892" candidate_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" candidate_term: 3 candidate_status { last_received { term: 1 index: 13589 } } ignore_live_leader: false dest_uuid: "0b8c8398fb4c416380f0d3cf94a253ca"
I20260615 08:07:45.919847 12172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f14099c6f843688e20cefda6479892" candidate_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" candidate_term: 3 candidate_status { last_received { term: 1 index: 13589 } } ignore_live_leader: false dest_uuid: "f9f6827b0f684080a6766793288630ef"
I20260615 08:07:45.919910 12172 raft_consensus.cc:3060] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [term 2 FOLLOWER]: Advancing to term 3
I20260615 08:07:45.920578 12172 raft_consensus.cc:2468] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 28354b9214c24d5f8d12f12b8f9f7aad in term 3.
W20260615 08:07:45.920699 12210 leader_election.cc:343] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 0b8c8398fb4c416380f0d3cf94a253ca (127.4.42.193:41713): Illegal state: must be running to vote when last-logged opid is not known
I20260615 08:07:45.920815 12211 leader_election.cc:304] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 28354b9214c24d5f8d12f12b8f9f7aad, f9f6827b0f684080a6766793288630ef; no voters: 0b8c8398fb4c416380f0d3cf94a253ca
I20260615 08:07:45.920954 12445 leader_election.cc:290] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad [CANDIDATE]: Term 3 election: Requested vote from peers 0b8c8398fb4c416380f0d3cf94a253ca (127.4.42.193:41713), f9f6827b0f684080a6766793288630ef (127.4.42.194:39381)
I20260615 08:07:45.921015 12450 raft_consensus.cc:2804] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad [term 3 FOLLOWER]: Leader election won for term 3
I20260615 08:07:45.921135 12450 raft_consensus.cc:697] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad [term 3 LEADER]: Becoming Leader. State: Replica: 28354b9214c24d5f8d12f12b8f9f7aad, State: Running, Role: LEADER
I20260615 08:07:45.921257 12450 consensus_queue.cc:237] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13589, Committed index: 13589, Last appended: 1.13589, Last appended by leader: 13589, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41713 } } peers { permanent_uuid: "f9f6827b0f684080a6766793288630ef" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39381 } } peers { permanent_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43035 } }
I20260615 08:07:45.921829 11988 catalog_manager.cc:5696] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad reported cstate change: term changed from 2 to 3, leader changed from 0b8c8398fb4c416380f0d3cf94a253ca (127.4.42.193) to 28354b9214c24d5f8d12f12b8f9f7aad (127.4.42.195). New cstate: current_term: 3 leader_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9f6827b0f684080a6766793288630ef" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43035 } health_report { overall_health: HEALTHY } } }
I20260615 08:07:45.954873 12380 tablet_bootstrap.cc:492] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca: Bootstrap replayed 2/3 log segments. Stats: ops{read=9871 overwritten=0 applied=9868 ignored=0} inserts{seen=493350 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 3 replicates
W20260615 08:07:46.349946 12210 consensus_peers.cc:597] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad -> Peer 0b8c8398fb4c416380f0d3cf94a253ca (127.4.42.193:41713): Couldn't send request to peer 0b8c8398fb4c416380f0d3cf94a253ca. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260615 08:07:46.363463 12172 raft_consensus.cc:1275] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [term 3 FOLLOWER]: Refusing update from remote peer 28354b9214c24d5f8d12f12b8f9f7aad: Log matching property violated. Preceding OpId in replica: term: 1 index: 13589. Preceding OpId from leader: term: 3 index: 13590. (index mismatch)
I20260615 08:07:46.363736 12450 consensus_queue.cc:1048] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9f6827b0f684080a6766793288630ef" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13590, Last known committed idx: 13589, Time since last communication: 0.000s
I20260615 08:07:46.599228 12380 tablet_bootstrap.cc:492] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca: Bootstrap replayed 3/3 log segments. Stats: ops{read=13590 overwritten=0 applied=13589 ignored=0} inserts{seen=679400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260615 08:07:46.599690 12380 tablet_bootstrap.cc:492] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca: Bootstrap complete.
I20260615 08:07:46.604357 12380 ts_tablet_manager.cc:1403] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca: Time spent bootstrapping tablet: real 2.297s user 2.026s sys 0.264s
I20260615 08:07:46.604523 12380 raft_consensus.cc:359] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [term 2 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41713 } } peers { permanent_uuid: "f9f6827b0f684080a6766793288630ef" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39381 } } peers { permanent_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43035 } }
I20260615 08:07:46.604607 12380 raft_consensus.cc:740] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b8c8398fb4c416380f0d3cf94a253ca, State: Initialized, Role: FOLLOWER
I20260615 08:07:46.604666 12380 consensus_queue.cc:260] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13589, Last appended: 2.13590, Last appended by leader: 13590, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41713 } } peers { permanent_uuid: "f9f6827b0f684080a6766793288630ef" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39381 } } peers { permanent_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43035 } }
I20260615 08:07:46.604837 12380 ts_tablet_manager.cc:1434] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca: Time spent starting tablet: real 0.000s user 0.002s sys 0.000s
W20260615 08:07:46.663360 12403 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46192: Illegal state: replica 0b8c8398fb4c416380f0d3cf94a253ca is not leader of this config: current role FOLLOWER
W20260615 08:07:46.732326 12162 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34950: Illegal state: replica f9f6827b0f684080a6766793288630ef is not leader of this config: current role FOLLOWER
I20260615 08:07:46.796469 12413 raft_consensus.cc:3060] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [term 2 FOLLOWER]: Advancing to term 3
I20260615 08:07:46.797261 12413 pending_rounds.cc:85] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca: Aborting all ops after (but not including) 13589
I20260615 08:07:46.797312 12413 pending_rounds.cc:107] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca: Aborting uncommitted NO_OP operation due to leader change: 2.13590
I20260615 08:07:46.797343 12413 raft_consensus.cc:2889] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260615 08:07:47.105093 4267 tablet_server.cc:179] TabletServer@127.4.42.194:0 shutting down...
W20260615 08:07:47.107460 12211 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
W20260615 08:07:47.108769 12211 consensus_peers.cc:597] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad -> Peer f9f6827b0f684080a6766793288630ef (127.4.42.194:39381): Couldn't send request to peer f9f6827b0f684080a6766793288630ef. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260615 08:07:47.108774 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:07:47.108911 4267 tablet_replica.cc:333] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef: stopping tablet replica
I20260615 08:07:47.108960 4267 raft_consensus.cc:2243] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [term 3 FOLLOWER]: Raft consensus shutting down.
I20260615 08:07:47.108996 4267 raft_consensus.cc:2272] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260615 08:07:47.126955 4267 tablet_server.cc:196] TabletServer@127.4.42.194:0 shutdown complete.
I20260615 08:07:47.127955 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:07:47.129045 12469 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:07:47.129117 12472 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:07:47.129165 12470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:07:47.129231 4267 server_base.cc:1061] running on GCE node
I20260615 08:07:47.129320 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:07:47.129349 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:07:47.129367 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510867129367 us; error 0 us; skew 500 ppm
I20260615 08:07:47.130036 4267 webserver.cc:533] Webserver started at http://127.4.42.194:32819/ using document root <none> and password file <none>
I20260615 08:07:47.130126 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:07:47.130162 4267 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260615 08:07:47.130832 4267 fs_manager.cc:714] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260615 08:07:47.131340 12477 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:47.131497 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260615 08:07:47.131537 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1781510637089012-4267-0/minicluster-data/ts-1-root
uuid: "f9f6827b0f684080a6766793288630ef"
format_stamp: "Formatted at 2026-06-15 08:07:33 on dist-test-slave-37n8"
I20260615 08:07:47.131596 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1781510637089012-4267-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1781510637089012-4267-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1781510637089012-4267-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:07:47.143976 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:07:47.144157 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:07:47.144299 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:07:47.144565 12484 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260615 08:07:47.145090 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260615 08:07:47.145128 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20260615 08:07:47.145148 4267 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260615 08:07:47.145534 4267 ts_tablet_manager.cc:616] Registered 1 tablets
I20260615 08:07:47.145568 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:47.145601 12484 tablet_bootstrap.cc:492] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef: Bootstrap starting.
I20260615 08:07:47.149060 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.194:39381
I20260615 08:07:47.151842 12542 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.194:39381 every 8 connection(s)
I20260615 08:07:47.157444 12543 heartbeater.cc:344] Connected to a master server at 127.4.42.254:37493
I20260615 08:07:47.157526 12543 heartbeater.cc:461] Registering TS with master...
I20260615 08:07:47.157644 12543 heartbeater.cc:507] Master 127.4.42.254:37493 requested a full tablet report, sending...
I20260615 08:07:47.157929 11993 ts_manager.cc:194] Re-registered known tserver with Master: f9f6827b0f684080a6766793288630ef (127.4.42.194:39381)
I20260615 08:07:47.158429 11993 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53390
I20260615 08:07:47.865955 12484 tablet_bootstrap.cc:492] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef: Bootstrap replayed 1/3 log segments. Stats: ops{read=4623 overwritten=0 applied=4620 ignored=0} inserts{seen=230950 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 3 replicates
I20260615 08:07:48.158931 12543 heartbeater.cc:499] Master 127.4.42.254:37493 was elected leader, sending a full tablet report...
I20260615 08:07:48.656607 12484 tablet_bootstrap.cc:492] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef: Bootstrap replayed 2/3 log segments. Stats: ops{read=9243 overwritten=0 applied=9240 ignored=0} inserts{seen=461950 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 3 replicates
I20260615 08:07:49.475152 12484 tablet_bootstrap.cc:492] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef: Bootstrap replayed 3/3 log segments. Stats: ops{read=13935 overwritten=0 applied=13935 ignored=0} inserts{seen=679400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260615 08:07:49.475560 12484 tablet_bootstrap.cc:492] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef: Bootstrap complete.
I20260615 08:07:49.480469 12484 ts_tablet_manager.cc:1403] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef: Time spent bootstrapping tablet: real 2.335s user 1.960s sys 0.371s
I20260615 08:07:49.480639 12484 raft_consensus.cc:359] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41713 } } peers { permanent_uuid: "f9f6827b0f684080a6766793288630ef" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39381 } } peers { permanent_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43035 } }
I20260615 08:07:49.480718 12484 raft_consensus.cc:740] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9f6827b0f684080a6766793288630ef, State: Initialized, Role: FOLLOWER
I20260615 08:07:49.480782 12484 consensus_queue.cc:260] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13935, Last appended: 3.13935, Last appended by leader: 13935, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41713 } } peers { permanent_uuid: "f9f6827b0f684080a6766793288630ef" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39381 } } peers { permanent_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43035 } }
I20260615 08:07:49.480957 12484 ts_tablet_manager.cc:1434] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef: Time spent starting tablet: real 0.000s user 0.002s sys 0.000s
I20260615 08:07:49.981196 4267 tablet_server.cc:179] TabletServer@127.4.42.195:0 shutting down...
I20260615 08:07:49.985448 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:07:49.985592 4267 tablet_replica.cc:333] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad: stopping tablet replica
I20260615 08:07:49.985661 4267 raft_consensus.cc:2243] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad [term 3 LEADER]: Raft consensus shutting down.
I20260615 08:07:49.985716 4267 raft_consensus.cc:2272] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad [term 3 FOLLOWER]: Raft consensus is shut down!
W20260615 08:07:49.990813 12359 meta_cache.cc:302] tablet 71f14099c6f843688e20cefda6479892: replica 28354b9214c24d5f8d12f12b8f9f7aad (127.4.42.195:43035) has failed: Network error: Client connection negotiation failed: client connection to 127.4.42.195:43035: connect: Connection refused (error 111)
I20260615 08:07:49.991142 4267 tablet_server.cc:196] TabletServer@127.4.42.195:0 shutdown complete.
I20260615 08:07:49.992316 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:07:49.993393 12568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:07:49.993414 12566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:07:49.993393 12565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:07:49.994108 4267 server_base.cc:1061] running on GCE node
I20260615 08:07:49.994217 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:07:49.994251 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:07:49.994278 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510869994278 us; error 0 us; skew 500 ppm
I20260615 08:07:49.994927 4267 webserver.cc:533] Webserver started at http://127.4.42.195:38913/ using document root <none> and password file <none>
I20260615 08:07:49.995047 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:07:49.995090 4267 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260615 08:07:49.995682 4267 fs_manager.cc:714] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
W20260615 08:07:49.996140 12403 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46192: Illegal state: replica 0b8c8398fb4c416380f0d3cf94a253ca is not leader of this config: current role FOLLOWER
I20260615 08:07:49.996155 12573 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:49.996412 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:49.996456 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1781510637089012-4267-0/minicluster-data/ts-2-root
uuid: "28354b9214c24d5f8d12f12b8f9f7aad"
format_stamp: "Formatted at 2026-06-15 08:07:33 on dist-test-slave-37n8"
I20260615 08:07:49.996526 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1781510637089012-4267-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1781510637089012-4267-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap.1781510637089012-4267-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260615 08:07:50.002247 12507 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34968: Illegal state: replica f9f6827b0f684080a6766793288630ef is not leader of this config: current role FOLLOWER
W20260615 08:07:50.016492 12403 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46192: Illegal state: replica 0b8c8398fb4c416380f0d3cf94a253ca is not leader of this config: current role FOLLOWER
I20260615 08:07:50.016942 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:07:50.017108 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:07:50.017244 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:07:50.017501 12581 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260615 08:07:50.017971 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260615 08:07:50.018018 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20260615 08:07:50.018055 4267 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260615 08:07:50.018414 4267 ts_tablet_manager.cc:616] Registered 1 tablets
I20260615 08:07:50.018453 12581 tablet_bootstrap.cc:492] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad: Bootstrap starting.
I20260615 08:07:50.018458 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:50.021775 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.195:43035
I20260615 08:07:50.025727 12639 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.195:43035 every 8 connection(s)
W20260615 08:07:50.025939 12507 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:34968: Illegal state: replica f9f6827b0f684080a6766793288630ef is not leader of this config: current role FOLLOWER
I20260615 08:07:50.030265 12640 heartbeater.cc:344] Connected to a master server at 127.4.42.254:37493
I20260615 08:07:50.030311 12640 heartbeater.cc:461] Registering TS with master...
I20260615 08:07:50.030377 12640 heartbeater.cc:507] Master 127.4.42.254:37493 requested a full tablet report, sending...
I20260615 08:07:50.030625 11993 ts_manager.cc:194] Re-registered known tserver with Master: 28354b9214c24d5f8d12f12b8f9f7aad (127.4.42.195:43035)
I20260615 08:07:50.030980 11993 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53398
I20260615 08:07:50.766549 12581 tablet_bootstrap.cc:492] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad: Bootstrap replayed 1/3 log segments. Stats: ops{read=4960 overwritten=0 applied=4960 ignored=0} inserts{seen=247950 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260615 08:07:51.031415 12640 heartbeater.cc:499] Master 127.4.42.254:37493 was elected leader, sending a full tablet report...
I20260615 08:07:51.484450 12647 raft_consensus.cc:493] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 28354b9214c24d5f8d12f12b8f9f7aad)
I20260615 08:07:51.484532 12647 raft_consensus.cc:515] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41713 } } peers { permanent_uuid: "f9f6827b0f684080a6766793288630ef" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39381 } } peers { permanent_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43035 } }
I20260615 08:07:51.484714 12647 leader_election.cc:290] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f9f6827b0f684080a6766793288630ef (127.4.42.194:39381), 28354b9214c24d5f8d12f12b8f9f7aad (127.4.42.195:43035)
I20260615 08:07:51.485287 12652 raft_consensus.cc:493] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 28354b9214c24d5f8d12f12b8f9f7aad)
I20260615 08:07:51.485412 12652 raft_consensus.cc:515] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41713 } } peers { permanent_uuid: "f9f6827b0f684080a6766793288630ef" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39381 } } peers { permanent_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43035 } }
I20260615 08:07:51.486202 12652 leader_election.cc:290] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0b8c8398fb4c416380f0d3cf94a253ca (127.4.42.193:41713), 28354b9214c24d5f8d12f12b8f9f7aad (127.4.42.195:43035)
I20260615 08:07:51.488333 12517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f14099c6f843688e20cefda6479892" candidate_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 14508 } } ignore_live_leader: false dest_uuid: "f9f6827b0f684080a6766793288630ef" is_pre_election: true
I20260615 08:07:51.488356 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f14099c6f843688e20cefda6479892" candidate_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 14508 } } ignore_live_leader: false dest_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" is_pre_election: true
I20260615 08:07:51.488404 12517 raft_consensus.cc:2468] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b8c8398fb4c416380f0d3cf94a253ca in term 3.
I20260615 08:07:51.488535 12375 leader_election.cc:304] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b8c8398fb4c416380f0d3cf94a253ca, f9f6827b0f684080a6766793288630ef; no voters:
I20260615 08:07:51.488615 12647 raft_consensus.cc:2804] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260615 08:07:51.488653 12647 raft_consensus.cc:493] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [term 3 FOLLOWER]: Starting leader election (detected failure of leader 28354b9214c24d5f8d12f12b8f9f7aad)
I20260615 08:07:51.488672 12647 raft_consensus.cc:3060] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [term 3 FOLLOWER]: Advancing to term 4
W20260615 08:07:51.488813 12377 leader_election.cc:343] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [CANDIDATE]: Term 4 pre-election: Tablet error from VoteRequest() call to peer 28354b9214c24d5f8d12f12b8f9f7aad (127.4.42.195:43035): Illegal state: must be running to vote when last-logged opid is not known
I20260615 08:07:51.489585 12647 raft_consensus.cc:515] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41713 } } peers { permanent_uuid: "f9f6827b0f684080a6766793288630ef" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39381 } } peers { permanent_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43035 } }
I20260615 08:07:51.489667 12413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f14099c6f843688e20cefda6479892" candidate_uuid: "f9f6827b0f684080a6766793288630ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 14508 } } ignore_live_leader: false dest_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" is_pre_election: true
I20260615 08:07:51.489739 12413 raft_consensus.cc:2393] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f9f6827b0f684080a6766793288630ef in current term 4: Already voted for candidate 0b8c8398fb4c416380f0d3cf94a253ca in this term.
I20260615 08:07:51.489748 12647 leader_election.cc:290] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [CANDIDATE]: Term 4 election: Requested vote from peers f9f6827b0f684080a6766793288630ef (127.4.42.194:39381), 28354b9214c24d5f8d12f12b8f9f7aad (127.4.42.195:43035)
I20260615 08:07:51.489892 12517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f14099c6f843688e20cefda6479892" candidate_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 14508 } } ignore_live_leader: false dest_uuid: "f9f6827b0f684080a6766793288630ef"
I20260615 08:07:51.489971 12517 raft_consensus.cc:3060] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [term 3 FOLLOWER]: Advancing to term 4
I20260615 08:07:51.489995 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f14099c6f843688e20cefda6479892" candidate_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" candidate_term: 4 candidate_status { last_received { term: 3 index: 14508 } } ignore_live_leader: false dest_uuid: "28354b9214c24d5f8d12f12b8f9f7aad"
W20260615 08:07:51.490132 12377 leader_election.cc:343] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [CANDIDATE]: Term 4 election: Tablet error from VoteRequest() call to peer 28354b9214c24d5f8d12f12b8f9f7aad (127.4.42.195:43035): Illegal state: must be running to vote when last-logged opid is not known
I20260615 08:07:51.490761 12517 raft_consensus.cc:2468] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b8c8398fb4c416380f0d3cf94a253ca in term 4.
I20260615 08:07:51.490916 12375 leader_election.cc:304] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0b8c8398fb4c416380f0d3cf94a253ca, f9f6827b0f684080a6766793288630ef; no voters: 28354b9214c24d5f8d12f12b8f9f7aad
I20260615 08:07:51.491019 12647 raft_consensus.cc:2804] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [term 4 FOLLOWER]: Leader election won for term 4
I20260615 08:07:51.491181 12647 raft_consensus.cc:697] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [term 4 LEADER]: Becoming Leader. State: Replica: 0b8c8398fb4c416380f0d3cf94a253ca, State: Running, Role: LEADER
I20260615 08:07:51.491242 12647 consensus_queue.cc:237] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14508, Committed index: 14508, Last appended: 3.14508, Last appended by leader: 14508, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41713 } } peers { permanent_uuid: "f9f6827b0f684080a6766793288630ef" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39381 } } peers { permanent_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43035 } }
I20260615 08:07:51.491724 11993 catalog_manager.cc:5696] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca reported cstate change: term changed from 3 to 4, leader changed from 28354b9214c24d5f8d12f12b8f9f7aad (127.4.42.195) to 0b8c8398fb4c416380f0d3cf94a253ca (127.4.42.193). New cstate: current_term: 4 leader_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9f6827b0f684080a6766793288630ef" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43035 } health_report { overall_health: UNKNOWN } } }
I20260615 08:07:51.492918 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71f14099c6f843688e20cefda6479892" candidate_uuid: "f9f6827b0f684080a6766793288630ef" candidate_term: 4 candidate_status { last_received { term: 3 index: 14508 } } ignore_live_leader: false dest_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" is_pre_election: true
W20260615 08:07:51.493117 12481 leader_election.cc:343] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [CANDIDATE]: Term 4 pre-election: Tablet error from VoteRequest() call to peer 28354b9214c24d5f8d12f12b8f9f7aad (127.4.42.195:43035): Illegal state: must be running to vote when last-logged opid is not known
I20260615 08:07:51.493170 12481 leader_election.cc:304] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9f6827b0f684080a6766793288630ef; no voters: 0b8c8398fb4c416380f0d3cf94a253ca, 28354b9214c24d5f8d12f12b8f9f7aad
I20260615 08:07:51.493563 12652 raft_consensus.cc:2749] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260615 08:07:51.599571 12581 tablet_bootstrap.cc:492] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad: Bootstrap replayed 2/3 log segments. Stats: ops{read=9906 overwritten=0 applied=9905 ignored=0} inserts{seen=495200 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260615 08:07:51.929767 12517 raft_consensus.cc:1275] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [term 4 FOLLOWER]: Refusing update from remote peer 0b8c8398fb4c416380f0d3cf94a253ca: Log matching property violated. Preceding OpId in replica: term: 3 index: 14508. Preceding OpId from leader: term: 4 index: 14509. (index mismatch)
I20260615 08:07:51.930434 12647 consensus_queue.cc:1048] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9f6827b0f684080a6766793288630ef" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14509, Last known committed idx: 14508, Time since last communication: 0.000s
W20260615 08:07:51.931806 12377 consensus_peers.cc:597] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca -> Peer 28354b9214c24d5f8d12f12b8f9f7aad (127.4.42.195:43035): Couldn't send request to peer 28354b9214c24d5f8d12f12b8f9f7aad. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260615 08:07:52.288270 12581 tablet_bootstrap.cc:492] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad: Bootstrap replayed 3/3 log segments. Stats: ops{read=14508 overwritten=0 applied=14508 ignored=0} inserts{seen=679400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260615 08:07:52.288743 12581 tablet_bootstrap.cc:492] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad: Bootstrap complete.
I20260615 08:07:52.293407 12581 ts_tablet_manager.cc:1403] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad: Time spent bootstrapping tablet: real 2.275s user 2.004s sys 0.267s
I20260615 08:07:52.293612 12581 raft_consensus.cc:359] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41713 } } peers { permanent_uuid: "f9f6827b0f684080a6766793288630ef" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39381 } } peers { permanent_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43035 } }
I20260615 08:07:52.293704 12581 raft_consensus.cc:740] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28354b9214c24d5f8d12f12b8f9f7aad, State: Initialized, Role: FOLLOWER
I20260615 08:07:52.293767 12581 consensus_queue.cc:260] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14508, Last appended: 3.14508, Last appended by leader: 14508, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0b8c8398fb4c416380f0d3cf94a253ca" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 41713 } } peers { permanent_uuid: "f9f6827b0f684080a6766793288630ef" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 39381 } } peers { permanent_uuid: "28354b9214c24d5f8d12f12b8f9f7aad" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43035 } }
I20260615 08:07:52.293958 12581 ts_tablet_manager.cc:1434] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad: Time spent starting tablet: real 0.000s user 0.003s sys 0.000s
W20260615 08:07:52.329442 12604 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:46462: Illegal state: replica 28354b9214c24d5f8d12f12b8f9f7aad is not leader of this config: current role FOLLOWER
I20260615 08:07:52.400460 12614 raft_consensus.cc:3060] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad [term 3 FOLLOWER]: Advancing to term 4
I20260615 08:07:53.058015 4267 tablet_server.cc:179] TabletServer@127.4.42.193:41713 shutting down...
I20260615 08:07:53.060997 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:07:53.061151 4267 tablet_replica.cc:333] stopping tablet replica
I20260615 08:07:53.061230 4267 raft_consensus.cc:2243] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [term 4 LEADER]: Raft consensus shutting down.
I20260615 08:07:53.061295 4267 raft_consensus.cc:2272] T 71f14099c6f843688e20cefda6479892 P 0b8c8398fb4c416380f0d3cf94a253ca [term 4 FOLLOWER]: Raft consensus is shut down!
I20260615 08:07:53.078361 4267 tablet_server.cc:196] TabletServer@127.4.42.193:41713 shutdown complete.
I20260615 08:07:53.079980 4267 tablet_server.cc:179] TabletServer@127.4.42.194:39381 shutting down...
I20260615 08:07:53.082723 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:07:53.082864 4267 tablet_replica.cc:333] stopping tablet replica
I20260615 08:07:53.082950 4267 raft_consensus.cc:2243] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [term 4 FOLLOWER]: Raft consensus shutting down.
I20260615 08:07:53.083002 4267 raft_consensus.cc:2272] T 71f14099c6f843688e20cefda6479892 P f9f6827b0f684080a6766793288630ef [term 4 FOLLOWER]: Raft consensus is shut down!
I20260615 08:07:53.098026 4267 tablet_server.cc:196] TabletServer@127.4.42.194:39381 shutdown complete.
I20260615 08:07:53.099224 4267 tablet_server.cc:179] TabletServer@127.4.42.195:43035 shutting down...
I20260615 08:07:53.101639 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:07:53.101773 4267 tablet_replica.cc:333] stopping tablet replica
I20260615 08:07:53.101830 4267 raft_consensus.cc:2243] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad [term 4 FOLLOWER]: Raft consensus shutting down.
I20260615 08:07:53.101883 4267 raft_consensus.cc:2272] T 71f14099c6f843688e20cefda6479892 P 28354b9214c24d5f8d12f12b8f9f7aad [term 4 FOLLOWER]: Raft consensus is shut down!
I20260615 08:07:53.126559 4267 tablet_server.cc:196] TabletServer@127.4.42.195:43035 shutdown complete.
I20260615 08:07:53.127787 4267 master.cc:562] Master@127.4.42.254:37493 shutting down...
I20260615 08:07:53.130321 4267 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 25565b9579814577837c33af136ed18a [term 1 LEADER]: Raft consensus shutting down.
I20260615 08:07:53.130393 4267 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 25565b9579814577837c33af136ed18a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:07:53.130441 4267 tablet_replica.cc:333] T 00000000000000000000000000000000 P 25565b9579814577837c33af136ed18a: stopping tablet replica
I20260615 08:07:53.143225 4267 master.cc:584] Master@127.4.42.254:37493 shutdown complete.
[ OK ] TxnParticipantITest.TestTxnSystemClientSucceedsOnBootstrap (19936 ms)
[ RUN ] TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound
I20260615 08:07:53.163406 4267 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.42.254:39961
I20260615 08:07:53.163585 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:07:53.164824 12675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:07:53.164901 4267 server_base.cc:1061] running on GCE node
W20260615 08:07:53.164878 12676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:07:53.164836 12678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:07:53.165144 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:07:53.165184 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:07:53.165196 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510873165197 us; error 0 us; skew 500 ppm
I20260615 08:07:53.165767 4267 webserver.cc:533] Webserver started at http://127.4.42.254:44465/ using document root <none> and password file <none>
I20260615 08:07:53.165867 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:07:53.165915 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:07:53.165958 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:07:53.166208 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1781510637089012-4267-0/minicluster-data/master-0-root/instance:
uuid: "1b6b9880b62749819d26b571ceb50fcd"
format_stamp: "Formatted at 2026-06-15 08:07:53 on dist-test-slave-37n8"
I20260615 08:07:53.167169 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:07:53.167641 12683 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:53.167752 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:53.167804 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1781510637089012-4267-0/minicluster-data/master-0-root
uuid: "1b6b9880b62749819d26b571ceb50fcd"
format_stamp: "Formatted at 2026-06-15 08:07:53 on dist-test-slave-37n8"
I20260615 08:07:53.167848 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1781510637089012-4267-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1781510637089012-4267-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1781510637089012-4267-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:07:53.173283 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:07:53.173463 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:07:53.175946 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.254:39961
I20260615 08:07:53.183990 12735 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.254:39961 every 8 connection(s)
I20260615 08:07:53.184103 12736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:07:53.185001 12736 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b6b9880b62749819d26b571ceb50fcd: Bootstrap starting.
I20260615 08:07:53.185243 12736 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1b6b9880b62749819d26b571ceb50fcd: Neither blocks nor log segments found. Creating new log.
I20260615 08:07:53.185667 12736 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b6b9880b62749819d26b571ceb50fcd: No bootstrap required, opened a new log
I20260615 08:07:53.185760 12736 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1b6b9880b62749819d26b571ceb50fcd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b6b9880b62749819d26b571ceb50fcd" member_type: VOTER }
I20260615 08:07:53.185799 12736 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1b6b9880b62749819d26b571ceb50fcd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:07:53.185812 12736 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1b6b9880b62749819d26b571ceb50fcd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b6b9880b62749819d26b571ceb50fcd, State: Initialized, Role: FOLLOWER
I20260615 08:07:53.185875 12736 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b6b9880b62749819d26b571ceb50fcd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b6b9880b62749819d26b571ceb50fcd" member_type: VOTER }
I20260615 08:07:53.185920 12736 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1b6b9880b62749819d26b571ceb50fcd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260615 08:07:53.185945 12736 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1b6b9880b62749819d26b571ceb50fcd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260615 08:07:53.185969 12736 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1b6b9880b62749819d26b571ceb50fcd [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:07:53.186407 12736 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1b6b9880b62749819d26b571ceb50fcd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b6b9880b62749819d26b571ceb50fcd" member_type: VOTER }
I20260615 08:07:53.186457 12736 leader_election.cc:304] T 00000000000000000000000000000000 P 1b6b9880b62749819d26b571ceb50fcd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b6b9880b62749819d26b571ceb50fcd; no voters:
I20260615 08:07:53.186604 12736 leader_election.cc:290] T 00000000000000000000000000000000 P 1b6b9880b62749819d26b571ceb50fcd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260615 08:07:53.186676 12739 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1b6b9880b62749819d26b571ceb50fcd [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:07:53.186746 12736 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1b6b9880b62749819d26b571ceb50fcd [sys.catalog]: configured and running, proceeding with master startup.
I20260615 08:07:53.186813 12739 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1b6b9880b62749819d26b571ceb50fcd [term 1 LEADER]: Becoming Leader. State: Replica: 1b6b9880b62749819d26b571ceb50fcd, State: Running, Role: LEADER
I20260615 08:07:53.186909 12739 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b6b9880b62749819d26b571ceb50fcd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b6b9880b62749819d26b571ceb50fcd" member_type: VOTER }
I20260615 08:07:53.187136 12740 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b6b9880b62749819d26b571ceb50fcd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1b6b9880b62749819d26b571ceb50fcd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b6b9880b62749819d26b571ceb50fcd" member_type: VOTER } }
I20260615 08:07:53.187288 12740 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b6b9880b62749819d26b571ceb50fcd [sys.catalog]: This master's current role is: LEADER
I20260615 08:07:53.187146 12741 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b6b9880b62749819d26b571ceb50fcd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b6b9880b62749819d26b571ceb50fcd. Latest consensus state: current_term: 1 leader_uuid: "1b6b9880b62749819d26b571ceb50fcd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b6b9880b62749819d26b571ceb50fcd" member_type: VOTER } }
I20260615 08:07:53.187418 12741 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b6b9880b62749819d26b571ceb50fcd [sys.catalog]: This master's current role is: LEADER
I20260615 08:07:53.187455 12748 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260615 08:07:53.187582 12748 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260615 08:07:53.188128 4267 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260615 08:07:53.188176 12748 catalog_manager.cc:1382] Generated new cluster ID: cb7c845751e64ea996ca2e4c8b5aeccf
I20260615 08:07:53.188208 12748 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260615 08:07:53.206605 12748 catalog_manager.cc:1405] Generated new certificate authority record
I20260615 08:07:53.207055 12748 catalog_manager.cc:1539] Loading token signing keys...
I20260615 08:07:53.215145 12748 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 1b6b9880b62749819d26b571ceb50fcd: Generated new TSK 0
I20260615 08:07:53.215220 12748 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260615 08:07:53.219925 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:07:53.221271 12758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:07:53.221328 4267 server_base.cc:1061] running on GCE node
W20260615 08:07:53.221282 12757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:07:53.221397 12760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:07:53.221531 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:07:53.221576 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:07:53.221589 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510873221590 us; error 0 us; skew 500 ppm
I20260615 08:07:53.222169 4267 webserver.cc:533] Webserver started at http://127.4.42.193:38603/ using document root <none> and password file <none>
I20260615 08:07:53.222237 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:07:53.222275 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:07:53.222332 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:07:53.222635 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1781510637089012-4267-0/minicluster-data/ts-0-root/instance:
uuid: "776c80c7e044453eb203234ec6e61ab6"
format_stamp: "Formatted at 2026-06-15 08:07:53 on dist-test-slave-37n8"
I20260615 08:07:53.223446 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:07:53.223873 12765 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:53.224011 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:53.224061 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1781510637089012-4267-0/minicluster-data/ts-0-root
uuid: "776c80c7e044453eb203234ec6e61ab6"
format_stamp: "Formatted at 2026-06-15 08:07:53 on dist-test-slave-37n8"
I20260615 08:07:53.224105 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1781510637089012-4267-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1781510637089012-4267-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1781510637089012-4267-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:07:53.232046 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:07:53.232184 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:07:53.232290 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:07:53.232424 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:07:53.232446 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:53.232465 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:07:53.232477 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:53.235222 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.193:40327
I20260615 08:07:53.235886 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260615 08:07:53.237056 12828 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.193:40327 every 8 connection(s)
W20260615 08:07:53.237686 12831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:07:53.237717 12832 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:07:53.237843 12834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:07:53.238190 4267 server_base.cc:1061] running on GCE node
I20260615 08:07:53.238310 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:07:53.238343 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:07:53.238363 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510873238364 us; error 0 us; skew 500 ppm
I20260615 08:07:53.238994 4267 webserver.cc:533] Webserver started at http://127.4.42.194:33769/ using document root <none> and password file <none>
I20260615 08:07:53.239089 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:07:53.239135 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:07:53.239190 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:07:53.239471 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1781510637089012-4267-0/minicluster-data/ts-1-root/instance:
uuid: "fbae2437fd094047aa172952ddef29bc"
format_stamp: "Formatted at 2026-06-15 08:07:53 on dist-test-slave-37n8"
I20260615 08:07:53.240639 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:07:53.241106 12829 heartbeater.cc:344] Connected to a master server at 127.4.42.254:39961
I20260615 08:07:53.241151 12841 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:53.241168 12829 heartbeater.cc:461] Registering TS with master...
I20260615 08:07:53.241326 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260615 08:07:53.241344 12829 heartbeater.cc:507] Master 127.4.42.254:39961 requested a full tablet report, sending...
I20260615 08:07:53.241374 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1781510637089012-4267-0/minicluster-data/ts-1-root
uuid: "fbae2437fd094047aa172952ddef29bc"
format_stamp: "Formatted at 2026-06-15 08:07:53 on dist-test-slave-37n8"
I20260615 08:07:53.241452 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1781510637089012-4267-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1781510637089012-4267-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1781510637089012-4267-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:07:53.241612 12700 ts_manager.cc:194] Registered new tserver with Master: 776c80c7e044453eb203234ec6e61ab6 (127.4.42.193:40327)
I20260615 08:07:53.242424 12700 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46198
I20260615 08:07:53.247345 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:07:53.247476 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:07:53.247574 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:07:53.247702 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:07:53.247725 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:53.247742 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:07:53.247756 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:53.250373 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.194:40277
I20260615 08:07:53.250977 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260615 08:07:53.251447 12904 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.194:40277 every 8 connection(s)
W20260615 08:07:53.252182 12910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:07:53.252182 12907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:07:53.252517 4267 server_base.cc:1061] running on GCE node
W20260615 08:07:53.252624 12908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:07:53.252785 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:07:53.252826 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:07:53.252843 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510873252844 us; error 0 us; skew 500 ppm
I20260615 08:07:53.253386 4267 webserver.cc:533] Webserver started at http://127.4.42.195:43541/ using document root <none> and password file <none>
I20260615 08:07:53.253473 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:07:53.253507 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:07:53.253540 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:07:53.253773 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1781510637089012-4267-0/minicluster-data/ts-2-root/instance:
uuid: "b0bf7af1b02f48ad802278b5fdf91d51"
format_stamp: "Formatted at 2026-06-15 08:07:53 on dist-test-slave-37n8"
I20260615 08:07:53.254865 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:07:53.255054 12905 heartbeater.cc:344] Connected to a master server at 127.4.42.254:39961
I20260615 08:07:53.255124 12905 heartbeater.cc:461] Registering TS with master...
I20260615 08:07:53.255234 12905 heartbeater.cc:507] Master 127.4.42.254:39961 requested a full tablet report, sending...
I20260615 08:07:53.255441 12916 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:53.255492 12700 ts_manager.cc:194] Registered new tserver with Master: fbae2437fd094047aa172952ddef29bc (127.4.42.194:40277)
I20260615 08:07:53.255582 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:53.255625 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1781510637089012-4267-0/minicluster-data/ts-2-root
uuid: "b0bf7af1b02f48ad802278b5fdf91d51"
format_stamp: "Formatted at 2026-06-15 08:07:53 on dist-test-slave-37n8"
I20260615 08:07:53.255666 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1781510637089012-4267-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1781510637089012-4267-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1781510637089012-4267-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:07:53.255985 12700 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46204
I20260615 08:07:53.269650 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:07:53.269825 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:07:53.269970 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:07:53.270146 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:07:53.270172 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:53.270215 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:07:53.270241 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:07:53.273259 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.195:33319
I20260615 08:07:53.273334 12979 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.195:33319 every 8 connection(s)
I20260615 08:07:53.276213 12980 heartbeater.cc:344] Connected to a master server at 127.4.42.254:39961
I20260615 08:07:53.276262 12980 heartbeater.cc:461] Registering TS with master...
I20260615 08:07:53.276360 12980 heartbeater.cc:507] Master 127.4.42.254:39961 requested a full tablet report, sending...
I20260615 08:07:53.276582 12700 ts_manager.cc:194] Registered new tserver with Master: b0bf7af1b02f48ad802278b5fdf91d51 (127.4.42.195:33319)
I20260615 08:07:53.276789 4267 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003311806s
I20260615 08:07:53.277077 12700 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46210
I20260615 08:07:53.281554 12700 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46222:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260615 08:07:53.281702 12700 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260615 08:07:53.286120 12944 tablet_service.cc:1511] Processing CreateTablet for tablet e68c8a71dc7b4a9e91ca777dbdf34315 (DEFAULT_TABLE table=test-workload [id=f53915c84f3540edb774bf6e958c610b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:07:53.286248 12944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e68c8a71dc7b4a9e91ca777dbdf34315. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:07:53.286616 12869 tablet_service.cc:1511] Processing CreateTablet for tablet e68c8a71dc7b4a9e91ca777dbdf34315 (DEFAULT_TABLE table=test-workload [id=f53915c84f3540edb774bf6e958c610b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:07:53.286707 12869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e68c8a71dc7b4a9e91ca777dbdf34315. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:07:53.287760 12995 tablet_bootstrap.cc:492] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51: Bootstrap starting.
I20260615 08:07:53.288156 12996 tablet_bootstrap.cc:492] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc: Bootstrap starting.
I20260615 08:07:53.288367 12995 tablet_bootstrap.cc:654] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51: Neither blocks nor log segments found. Creating new log.
I20260615 08:07:53.288532 12793 tablet_service.cc:1511] Processing CreateTablet for tablet e68c8a71dc7b4a9e91ca777dbdf34315 (DEFAULT_TABLE table=test-workload [id=f53915c84f3540edb774bf6e958c610b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:07:53.288615 12996 tablet_bootstrap.cc:654] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc: Neither blocks nor log segments found. Creating new log.
I20260615 08:07:53.288636 12793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e68c8a71dc7b4a9e91ca777dbdf34315. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:07:53.289131 12996 tablet_bootstrap.cc:492] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc: No bootstrap required, opened a new log
I20260615 08:07:53.289187 12996 ts_tablet_manager.cc:1403] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:07:53.289338 12996 raft_consensus.cc:359] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0bf7af1b02f48ad802278b5fdf91d51" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33319 } } peers { permanent_uuid: "fbae2437fd094047aa172952ddef29bc" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 40277 } } peers { permanent_uuid: "776c80c7e044453eb203234ec6e61ab6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40327 } }
I20260615 08:07:53.289415 12996 raft_consensus.cc:385] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:07:53.289436 12996 raft_consensus.cc:740] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbae2437fd094047aa172952ddef29bc, State: Initialized, Role: FOLLOWER
I20260615 08:07:53.289489 12996 consensus_queue.cc:260] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0bf7af1b02f48ad802278b5fdf91d51" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33319 } } peers { permanent_uuid: "fbae2437fd094047aa172952ddef29bc" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 40277 } } peers { permanent_uuid: "776c80c7e044453eb203234ec6e61ab6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40327 } }
I20260615 08:07:53.289635 12996 ts_tablet_manager.cc:1434] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260615 08:07:53.289675 12905 heartbeater.cc:499] Master 127.4.42.254:39961 was elected leader, sending a full tablet report...
I20260615 08:07:53.290020 13000 tablet_bootstrap.cc:492] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6: Bootstrap starting.
I20260615 08:07:53.290385 12995 tablet_bootstrap.cc:492] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51: No bootstrap required, opened a new log
I20260615 08:07:53.290434 12995 ts_tablet_manager.cc:1403] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260615 08:07:53.290458 13000 tablet_bootstrap.cc:654] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6: Neither blocks nor log segments found. Creating new log.
I20260615 08:07:53.290598 12995 raft_consensus.cc:359] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0bf7af1b02f48ad802278b5fdf91d51" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33319 } } peers { permanent_uuid: "fbae2437fd094047aa172952ddef29bc" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 40277 } } peers { permanent_uuid: "776c80c7e044453eb203234ec6e61ab6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40327 } }
I20260615 08:07:53.290668 12995 raft_consensus.cc:385] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:07:53.290696 12995 raft_consensus.cc:740] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0bf7af1b02f48ad802278b5fdf91d51, State: Initialized, Role: FOLLOWER
I20260615 08:07:53.290745 12995 consensus_queue.cc:260] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0bf7af1b02f48ad802278b5fdf91d51" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33319 } } peers { permanent_uuid: "fbae2437fd094047aa172952ddef29bc" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 40277 } } peers { permanent_uuid: "776c80c7e044453eb203234ec6e61ab6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40327 } }
I20260615 08:07:53.290913 12995 ts_tablet_manager.cc:1434] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260615 08:07:53.290951 12980 heartbeater.cc:499] Master 127.4.42.254:39961 was elected leader, sending a full tablet report...
I20260615 08:07:53.291112 13000 tablet_bootstrap.cc:492] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6: No bootstrap required, opened a new log
I20260615 08:07:53.291167 13000 ts_tablet_manager.cc:1403] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:07:53.291306 13000 raft_consensus.cc:359] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0bf7af1b02f48ad802278b5fdf91d51" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33319 } } peers { permanent_uuid: "fbae2437fd094047aa172952ddef29bc" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 40277 } } peers { permanent_uuid: "776c80c7e044453eb203234ec6e61ab6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40327 } }
I20260615 08:07:53.291416 13000 raft_consensus.cc:385] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:07:53.291445 13000 raft_consensus.cc:740] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 776c80c7e044453eb203234ec6e61ab6, State: Initialized, Role: FOLLOWER
I20260615 08:07:53.291504 13000 consensus_queue.cc:260] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0bf7af1b02f48ad802278b5fdf91d51" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33319 } } peers { permanent_uuid: "fbae2437fd094047aa172952ddef29bc" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 40277 } } peers { permanent_uuid: "776c80c7e044453eb203234ec6e61ab6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40327 } }
I20260615 08:07:53.291706 12829 heartbeater.cc:499] Master 127.4.42.254:39961 was elected leader, sending a full tablet report...
I20260615 08:07:53.291814 13000 ts_tablet_manager.cc:1434] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:07:53.388041 13002 raft_consensus.cc:493] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260615 08:07:53.388171 13002 raft_consensus.cc:515] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0bf7af1b02f48ad802278b5fdf91d51" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33319 } } peers { permanent_uuid: "fbae2437fd094047aa172952ddef29bc" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 40277 } } peers { permanent_uuid: "776c80c7e044453eb203234ec6e61ab6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40327 } }
I20260615 08:07:53.388420 13002 leader_election.cc:290] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbae2437fd094047aa172952ddef29bc (127.4.42.194:40277), 776c80c7e044453eb203234ec6e61ab6 (127.4.42.193:40327)
I20260615 08:07:53.388736 13003 raft_consensus.cc:493] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260615 08:07:53.388844 13003 raft_consensus.cc:515] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0bf7af1b02f48ad802278b5fdf91d51" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33319 } } peers { permanent_uuid: "fbae2437fd094047aa172952ddef29bc" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 40277 } } peers { permanent_uuid: "776c80c7e044453eb203234ec6e61ab6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40327 } }
I20260615 08:07:53.389183 13003 leader_election.cc:290] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b0bf7af1b02f48ad802278b5fdf91d51 (127.4.42.195:33319), fbae2437fd094047aa172952ddef29bc (127.4.42.194:40277)
I20260615 08:07:53.391750 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e68c8a71dc7b4a9e91ca777dbdf34315" candidate_uuid: "b0bf7af1b02f48ad802278b5fdf91d51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbae2437fd094047aa172952ddef29bc" is_pre_election: true
I20260615 08:07:53.391754 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e68c8a71dc7b4a9e91ca777dbdf34315" candidate_uuid: "b0bf7af1b02f48ad802278b5fdf91d51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "776c80c7e044453eb203234ec6e61ab6" is_pre_election: true
I20260615 08:07:53.391851 12879 raft_consensus.cc:2468] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0bf7af1b02f48ad802278b5fdf91d51 in term 0.
I20260615 08:07:53.391876 12803 raft_consensus.cc:2468] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0bf7af1b02f48ad802278b5fdf91d51 in term 0.
I20260615 08:07:53.391984 12919 leader_election.cc:304] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0bf7af1b02f48ad802278b5fdf91d51, fbae2437fd094047aa172952ddef29bc; no voters:
I20260615 08:07:53.392073 13002 raft_consensus.cc:2804] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260615 08:07:53.392099 13002 raft_consensus.cc:493] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:07:53.392117 13002 raft_consensus.cc:3060] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:07:53.392125 12954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e68c8a71dc7b4a9e91ca777dbdf34315" candidate_uuid: "776c80c7e044453eb203234ec6e61ab6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0bf7af1b02f48ad802278b5fdf91d51" is_pre_election: true
I20260615 08:07:53.392735 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e68c8a71dc7b4a9e91ca777dbdf34315" candidate_uuid: "776c80c7e044453eb203234ec6e61ab6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbae2437fd094047aa172952ddef29bc" is_pre_election: true
I20260615 08:07:53.392791 12879 raft_consensus.cc:2468] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 776c80c7e044453eb203234ec6e61ab6 in term 0.
I20260615 08:07:53.392940 12768 leader_election.cc:304] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 776c80c7e044453eb203234ec6e61ab6, fbae2437fd094047aa172952ddef29bc; no voters:
I20260615 08:07:53.393045 13002 raft_consensus.cc:515] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0bf7af1b02f48ad802278b5fdf91d51" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33319 } } peers { permanent_uuid: "fbae2437fd094047aa172952ddef29bc" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 40277 } } peers { permanent_uuid: "776c80c7e044453eb203234ec6e61ab6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40327 } }
I20260615 08:07:53.393045 13003 raft_consensus.cc:2804] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260615 08:07:53.393169 13003 raft_consensus.cc:493] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:07:53.393210 12954 raft_consensus.cc:2393] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 776c80c7e044453eb203234ec6e61ab6 in current term 1: Already voted for candidate b0bf7af1b02f48ad802278b5fdf91d51 in this term.
I20260615 08:07:53.393221 13003 raft_consensus.cc:3060] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:07:53.393384 12803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e68c8a71dc7b4a9e91ca777dbdf34315" candidate_uuid: "b0bf7af1b02f48ad802278b5fdf91d51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "776c80c7e044453eb203234ec6e61ab6"
I20260615 08:07:53.393384 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e68c8a71dc7b4a9e91ca777dbdf34315" candidate_uuid: "b0bf7af1b02f48ad802278b5fdf91d51" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbae2437fd094047aa172952ddef29bc"
I20260615 08:07:53.393473 12879 raft_consensus.cc:3060] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:07:53.393837 13003 raft_consensus.cc:515] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0bf7af1b02f48ad802278b5fdf91d51" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33319 } } peers { permanent_uuid: "fbae2437fd094047aa172952ddef29bc" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 40277 } } peers { permanent_uuid: "776c80c7e044453eb203234ec6e61ab6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40327 } }
I20260615 08:07:53.393965 12803 raft_consensus.cc:2393] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b0bf7af1b02f48ad802278b5fdf91d51 in current term 1: Already voted for candidate 776c80c7e044453eb203234ec6e61ab6 in this term.
I20260615 08:07:53.393993 13003 leader_election.cc:290] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [CANDIDATE]: Term 1 election: Requested vote from peers b0bf7af1b02f48ad802278b5fdf91d51 (127.4.42.195:33319), fbae2437fd094047aa172952ddef29bc (127.4.42.194:40277)
I20260615 08:07:53.394196 12879 raft_consensus.cc:2468] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0bf7af1b02f48ad802278b5fdf91d51 in term 1.
I20260615 08:07:53.394249 12878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e68c8a71dc7b4a9e91ca777dbdf34315" candidate_uuid: "776c80c7e044453eb203234ec6e61ab6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbae2437fd094047aa172952ddef29bc"
I20260615 08:07:53.394335 12878 raft_consensus.cc:2393] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 776c80c7e044453eb203234ec6e61ab6 in current term 1: Already voted for candidate b0bf7af1b02f48ad802278b5fdf91d51 in this term.
I20260615 08:07:53.394376 12919 leader_election.cc:304] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0bf7af1b02f48ad802278b5fdf91d51, fbae2437fd094047aa172952ddef29bc; no voters:
I20260615 08:07:53.394508 12954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e68c8a71dc7b4a9e91ca777dbdf34315" candidate_uuid: "776c80c7e044453eb203234ec6e61ab6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0bf7af1b02f48ad802278b5fdf91d51"
I20260615 08:07:53.394590 13007 raft_consensus.cc:2804] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:07:53.393393 13002 leader_election.cc:290] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 [CANDIDATE]: Term 1 election: Requested vote from peers fbae2437fd094047aa172952ddef29bc (127.4.42.194:40277), 776c80c7e044453eb203234ec6e61ab6 (127.4.42.193:40327)
I20260615 08:07:53.394693 13007 raft_consensus.cc:697] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 [term 1 LEADER]: Becoming Leader. State: Replica: b0bf7af1b02f48ad802278b5fdf91d51, State: Running, Role: LEADER
I20260615 08:07:53.394754 13007 consensus_queue.cc:237] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0bf7af1b02f48ad802278b5fdf91d51" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33319 } } peers { permanent_uuid: "fbae2437fd094047aa172952ddef29bc" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 40277 } } peers { permanent_uuid: "776c80c7e044453eb203234ec6e61ab6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40327 } }
I20260615 08:07:53.395153 12767 leader_election.cc:304] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 776c80c7e044453eb203234ec6e61ab6; no voters: b0bf7af1b02f48ad802278b5fdf91d51, fbae2437fd094047aa172952ddef29bc
I20260615 08:07:53.395265 13003 raft_consensus.cc:2749] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260615 08:07:53.395283 12699 catalog_manager.cc:5696] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0bf7af1b02f48ad802278b5fdf91d51 (127.4.42.195). New cstate: current_term: 1 leader_uuid: "b0bf7af1b02f48ad802278b5fdf91d51" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0bf7af1b02f48ad802278b5fdf91d51" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbae2437fd094047aa172952ddef29bc" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 40277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "776c80c7e044453eb203234ec6e61ab6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40327 } health_report { overall_health: UNKNOWN } } }
I20260615 08:07:53.409404 12803 raft_consensus.cc:1275] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 1 FOLLOWER]: Refusing update from remote peer b0bf7af1b02f48ad802278b5fdf91d51: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:07:53.409420 12878 raft_consensus.cc:1275] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [term 1 FOLLOWER]: Refusing update from remote peer b0bf7af1b02f48ad802278b5fdf91d51: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:07:53.409636 13007 consensus_queue.cc:1048] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "776c80c7e044453eb203234ec6e61ab6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:07:53.409741 13008 consensus_queue.cc:1048] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbae2437fd094047aa172952ddef29bc" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 40277 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:08:04.013468 13036 raft_consensus.cc:993] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51: : Instructing follower 776c80c7e044453eb203234ec6e61ab6 to start an election
I20260615 08:08:04.013571 13036 raft_consensus.cc:1081] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 [term 1 LEADER]: Signalling peer 776c80c7e044453eb203234ec6e61ab6 to start an election
I20260615 08:08:04.013823 12802 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e68c8a71dc7b4a9e91ca777dbdf34315"
dest_uuid: "776c80c7e044453eb203234ec6e61ab6"
from {username='slave'} at 127.0.0.1:34784
I20260615 08:08:04.013892 12802 raft_consensus.cc:493] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260615 08:08:04.013912 12802 raft_consensus.cc:3060] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:08:04.014536 12802 raft_consensus.cc:515] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0bf7af1b02f48ad802278b5fdf91d51" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33319 } } peers { permanent_uuid: "fbae2437fd094047aa172952ddef29bc" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 40277 } } peers { permanent_uuid: "776c80c7e044453eb203234ec6e61ab6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40327 } }
I20260615 08:08:04.014703 12802 leader_election.cc:290] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [CANDIDATE]: Term 2 election: Requested vote from peers b0bf7af1b02f48ad802278b5fdf91d51 (127.4.42.195:33319), fbae2437fd094047aa172952ddef29bc (127.4.42.194:40277)
I20260615 08:08:04.014827 12954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e68c8a71dc7b4a9e91ca777dbdf34315" candidate_uuid: "776c80c7e044453eb203234ec6e61ab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 13763 } } ignore_live_leader: true dest_uuid: "b0bf7af1b02f48ad802278b5fdf91d51"
I20260615 08:08:04.014916 12954 raft_consensus.cc:3055] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 [term 1 LEADER]: Stepping down as leader of term 1
I20260615 08:08:04.014887 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e68c8a71dc7b4a9e91ca777dbdf34315" candidate_uuid: "776c80c7e044453eb203234ec6e61ab6" candidate_term: 2 candidate_status { last_received { term: 1 index: 13763 } } ignore_live_leader: true dest_uuid: "fbae2437fd094047aa172952ddef29bc"
I20260615 08:08:04.014971 12954 raft_consensus.cc:740] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b0bf7af1b02f48ad802278b5fdf91d51, State: Running, Role: LEADER
I20260615 08:08:04.014995 12879 raft_consensus.cc:3060] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:08:04.015029 12954 consensus_queue.cc:260] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13763, Committed index: 13763, Last appended: 1.13763, Last appended by leader: 13763, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0bf7af1b02f48ad802278b5fdf91d51" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33319 } } peers { permanent_uuid: "fbae2437fd094047aa172952ddef29bc" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 40277 } } peers { permanent_uuid: "776c80c7e044453eb203234ec6e61ab6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40327 } }
I20260615 08:08:04.015156 12954 raft_consensus.cc:3060] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:08:04.015764 12879 raft_consensus.cc:2468] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 776c80c7e044453eb203234ec6e61ab6 in term 2.
I20260615 08:08:04.015789 12954 raft_consensus.cc:2468] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 776c80c7e044453eb203234ec6e61ab6 in term 2.
I20260615 08:08:04.015962 12768 leader_election.cc:304] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 776c80c7e044453eb203234ec6e61ab6, fbae2437fd094047aa172952ddef29bc; no voters:
I20260615 08:08:04.016144 13057 raft_consensus.cc:2804] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 2 FOLLOWER]: Leader election won for term 2
I20260615 08:08:04.016256 13057 raft_consensus.cc:697] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 2 LEADER]: Becoming Leader. State: Replica: 776c80c7e044453eb203234ec6e61ab6, State: Running, Role: LEADER
I20260615 08:08:04.016314 13057 consensus_queue.cc:237] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13763, Committed index: 13763, Last appended: 1.13763, Last appended by leader: 13763, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0bf7af1b02f48ad802278b5fdf91d51" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33319 } } peers { permanent_uuid: "fbae2437fd094047aa172952ddef29bc" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 40277 } } peers { permanent_uuid: "776c80c7e044453eb203234ec6e61ab6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40327 } }
I20260615 08:08:04.016791 12699 catalog_manager.cc:5696] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 reported cstate change: term changed from 1 to 2, leader changed from b0bf7af1b02f48ad802278b5fdf91d51 (127.4.42.195) to 776c80c7e044453eb203234ec6e61ab6 (127.4.42.193). New cstate: current_term: 2 leader_uuid: "776c80c7e044453eb203234ec6e61ab6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0bf7af1b02f48ad802278b5fdf91d51" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbae2437fd094047aa172952ddef29bc" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 40277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "776c80c7e044453eb203234ec6e61ab6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40327 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:04.025074 4267 tablet_replica.cc:333] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6: stopping tablet replica
I20260615 08:08:04.025125 4267 raft_consensus.cc:2243] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 2 LEADER]: Raft consensus shutting down.
I20260615 08:08:04.025195 4267 pending_rounds.cc:70] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6: Trying to abort 1 pending ops.
I20260615 08:08:04.025230 4267 pending_rounds.cc:77] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6: Aborting op as it isn't in flight: id { term: 2 index: 13764 } timestamp: 7297068580931473408 op_type: NO_OP noop_request { }
I20260615 08:08:04.025277 4267 raft_consensus.cc:2889] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260615 08:08:04.025308 4267 raft_consensus.cc:2272] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:08:04.033470 4267 ts_tablet_manager.cc:1916] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260615 08:08:04.034744 4267 ts_tablet_manager.cc:1929] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.13764
I20260615 08:08:04.034807 4267 log.cc:1199] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6: Deleting WAL directory at /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/e68c8a71dc7b4a9e91ca777dbdf34315
I20260615 08:08:06.087806 13072 raft_consensus.cc:493] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260615 08:08:06.087918 13072 raft_consensus.cc:515] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0bf7af1b02f48ad802278b5fdf91d51" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33319 } } peers { permanent_uuid: "fbae2437fd094047aa172952ddef29bc" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 40277 } } peers { permanent_uuid: "776c80c7e044453eb203234ec6e61ab6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40327 } }
I20260615 08:08:06.088155 13072 leader_election.cc:290] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b0bf7af1b02f48ad802278b5fdf91d51 (127.4.42.195:33319), 776c80c7e044453eb203234ec6e61ab6 (127.4.42.193:40327)
I20260615 08:08:06.090809 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e68c8a71dc7b4a9e91ca777dbdf34315" candidate_uuid: "fbae2437fd094047aa172952ddef29bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 13763 } } ignore_live_leader: false dest_uuid: "776c80c7e044453eb203234ec6e61ab6" is_pre_election: true
I20260615 08:08:06.090915 12802 raft_consensus.cc:1803] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 2 FOLLOWER]: voting while tombstoned based on last-logged opid 2.13764
I20260615 08:08:06.090888 12954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e68c8a71dc7b4a9e91ca777dbdf34315" candidate_uuid: "fbae2437fd094047aa172952ddef29bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 13763 } } ignore_live_leader: false dest_uuid: "b0bf7af1b02f48ad802278b5fdf91d51" is_pre_election: true
I20260615 08:08:06.090974 12802 raft_consensus.cc:2410] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fbae2437fd094047aa172952ddef29bc for term 3 because replica has last-logged OpId of term: 2 index: 13764, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 13763.
I20260615 08:08:06.090974 12954 raft_consensus.cc:2468] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbae2437fd094047aa172952ddef29bc in term 2.
I20260615 08:08:06.091163 12843 leader_election.cc:304] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b0bf7af1b02f48ad802278b5fdf91d51, fbae2437fd094047aa172952ddef29bc; no voters: 776c80c7e044453eb203234ec6e61ab6
I20260615 08:08:06.091305 13072 raft_consensus.cc:2804] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260615 08:08:06.091353 13072 raft_consensus.cc:493] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:06.091401 13072 raft_consensus.cc:3060] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [term 2 FOLLOWER]: Advancing to term 3
I20260615 08:08:06.092032 13072 raft_consensus.cc:515] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0bf7af1b02f48ad802278b5fdf91d51" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33319 } } peers { permanent_uuid: "fbae2437fd094047aa172952ddef29bc" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 40277 } } peers { permanent_uuid: "776c80c7e044453eb203234ec6e61ab6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40327 } }
I20260615 08:08:06.092171 13072 leader_election.cc:290] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [CANDIDATE]: Term 3 election: Requested vote from peers b0bf7af1b02f48ad802278b5fdf91d51 (127.4.42.195:33319), 776c80c7e044453eb203234ec6e61ab6 (127.4.42.193:40327)
I20260615 08:08:06.092298 12954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e68c8a71dc7b4a9e91ca777dbdf34315" candidate_uuid: "fbae2437fd094047aa172952ddef29bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 13763 } } ignore_live_leader: false dest_uuid: "b0bf7af1b02f48ad802278b5fdf91d51"
I20260615 08:08:06.092298 12802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e68c8a71dc7b4a9e91ca777dbdf34315" candidate_uuid: "fbae2437fd094047aa172952ddef29bc" candidate_term: 3 candidate_status { last_received { term: 1 index: 13763 } } ignore_live_leader: false dest_uuid: "776c80c7e044453eb203234ec6e61ab6"
I20260615 08:08:06.092387 12954 raft_consensus.cc:3060] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 [term 2 FOLLOWER]: Advancing to term 3
I20260615 08:08:06.092389 12802 raft_consensus.cc:1803] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 2 FOLLOWER]: voting while tombstoned based on last-logged opid 2.13764
I20260615 08:08:06.092463 12802 raft_consensus.cc:3060] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 2 FOLLOWER]: Advancing to term 3
I20260615 08:08:06.093086 12954 raft_consensus.cc:2468] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbae2437fd094047aa172952ddef29bc in term 3.
I20260615 08:08:06.093101 12802 raft_consensus.cc:2410] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fbae2437fd094047aa172952ddef29bc for term 3 because replica has last-logged OpId of term: 2 index: 13764, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 13763.
I20260615 08:08:06.093268 12843 leader_election.cc:304] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b0bf7af1b02f48ad802278b5fdf91d51, fbae2437fd094047aa172952ddef29bc; no voters:
I20260615 08:08:06.093377 13072 raft_consensus.cc:2804] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [term 3 FOLLOWER]: Leader election won for term 3
I20260615 08:08:06.093528 13072 raft_consensus.cc:697] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [term 3 LEADER]: Becoming Leader. State: Replica: fbae2437fd094047aa172952ddef29bc, State: Running, Role: LEADER
I20260615 08:08:06.093611 13072 consensus_queue.cc:237] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13763, Committed index: 13763, Last appended: 1.13763, Last appended by leader: 13763, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0bf7af1b02f48ad802278b5fdf91d51" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33319 } } peers { permanent_uuid: "fbae2437fd094047aa172952ddef29bc" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 40277 } } peers { permanent_uuid: "776c80c7e044453eb203234ec6e61ab6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40327 } }
I20260615 08:08:06.094087 12699 catalog_manager.cc:5696] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc reported cstate change: term changed from 2 to 3, leader changed from 776c80c7e044453eb203234ec6e61ab6 (127.4.42.193) to fbae2437fd094047aa172952ddef29bc (127.4.42.194). New cstate: current_term: 3 leader_uuid: "fbae2437fd094047aa172952ddef29bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0bf7af1b02f48ad802278b5fdf91d51" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbae2437fd094047aa172952ddef29bc" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 40277 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "776c80c7e044453eb203234ec6e61ab6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40327 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:06.104492 12954 raft_consensus.cc:1275] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 [term 3 FOLLOWER]: Refusing update from remote peer fbae2437fd094047aa172952ddef29bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 13763. Preceding OpId from leader: term: 3 index: 13765. (index mismatch)
W20260615 08:08:06.104658 12842 consensus_peers.cc:597] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc -> Peer 776c80c7e044453eb203234ec6e61ab6 (127.4.42.193:40327): Couldn't send request to peer 776c80c7e044453eb203234ec6e61ab6. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260615 08:08:06.104698 13077 consensus_queue.cc:1048] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b0bf7af1b02f48ad802278b5fdf91d51" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13764, Last known committed idx: 13763, Time since last communication: 0.000s
I20260615 08:08:06.105929 13086 mvcc.cc:204] Tried to move back new op lower bound from 7297068589482946560 to 7297068589439946752. Current Snapshot: MvccSnapshot[applied={T|T < 7297068589482946560}]
I20260615 08:08:06.594309 13093 ts_tablet_manager.cc:933] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6: Initiating tablet copy from peer fbae2437fd094047aa172952ddef29bc (127.4.42.194:40277)
I20260615 08:08:06.594561 13093 tablet_copy_client.cc:323] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6: tablet copy: Beginning tablet copy session from remote peer at address 127.4.42.194:40277
I20260615 08:08:06.594933 12889 tablet_copy_service.cc:140] P fbae2437fd094047aa172952ddef29bc: Received BeginTabletCopySession request for tablet e68c8a71dc7b4a9e91ca777dbdf34315 from peer 776c80c7e044453eb203234ec6e61ab6 ({username='slave'} at 127.0.0.1:55880)
I20260615 08:08:06.595021 12889 tablet_copy_service.cc:161] P fbae2437fd094047aa172952ddef29bc: Beginning new tablet copy session on tablet e68c8a71dc7b4a9e91ca777dbdf34315 from peer 776c80c7e044453eb203234ec6e61ab6 at {username='slave'} at 127.0.0.1:55880: session id = 776c80c7e044453eb203234ec6e61ab6-e68c8a71dc7b4a9e91ca777dbdf34315
I20260615 08:08:06.595588 12889 tablet_copy_source_session.cc:215] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc: Tablet Copy: opened 0 blocks and 3 log segments
I20260615 08:08:06.596002 13093 ts_tablet_manager.cc:1916] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260615 08:08:06.597306 13093 ts_tablet_manager.cc:1929] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 2.13764
I20260615 08:08:06.597426 13093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e68c8a71dc7b4a9e91ca777dbdf34315. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:08:06.597992 13093 tablet_copy_client.cc:806] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6: tablet copy: Starting download of 0 data blocks...
I20260615 08:08:06.598112 13093 tablet_copy_client.cc:670] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6: tablet copy: Starting download of 3 WAL segments...
I20260615 08:08:06.635810 13093 tablet_copy_client.cc:538] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260615 08:08:06.636688 13093 tablet_bootstrap.cc:492] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6: Bootstrap starting.
I20260615 08:08:07.463451 13093 tablet_bootstrap.cc:492] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6: Bootstrap replayed 1/3 log segments. Stats: ops{read=4965 overwritten=0 applied=4963 ignored=0} inserts{seen=248100 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20260615 08:08:08.309963 13093 tablet_bootstrap.cc:492] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6: Bootstrap replayed 2/3 log segments. Stats: ops{read=9920 overwritten=0 applied=9917 ignored=0} inserts{seen=495800 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 3 replicates
I20260615 08:08:08.981945 13093 tablet_bootstrap.cc:492] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6: Bootstrap replayed 3/3 log segments. Stats: ops{read=13867 overwritten=0 applied=13866 ignored=0} inserts{seen=688100 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260615 08:08:08.982260 13093 tablet_bootstrap.cc:492] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6: Bootstrap complete.
I20260615 08:08:08.986804 13093 ts_tablet_manager.cc:1403] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6: Time spent bootstrapping tablet: real 2.350s user 2.105s sys 0.245s
I20260615 08:08:08.986967 13093 raft_consensus.cc:359] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 3 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0bf7af1b02f48ad802278b5fdf91d51" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33319 } } peers { permanent_uuid: "fbae2437fd094047aa172952ddef29bc" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 40277 } } peers { permanent_uuid: "776c80c7e044453eb203234ec6e61ab6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40327 } }
I20260615 08:08:08.987150 13093 raft_consensus.cc:740] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 776c80c7e044453eb203234ec6e61ab6, State: Initialized, Role: FOLLOWER
I20260615 08:08:08.987253 13093 consensus_queue.cc:260] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13866, Last appended: 3.13867, Last appended by leader: 13867, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0bf7af1b02f48ad802278b5fdf91d51" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33319 } } peers { permanent_uuid: "fbae2437fd094047aa172952ddef29bc" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 40277 } } peers { permanent_uuid: "776c80c7e044453eb203234ec6e61ab6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40327 } }
I20260615 08:08:08.987434 13093 ts_tablet_manager.cc:1434] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:08:08.987773 12887 tablet_copy_service.cc:342] P fbae2437fd094047aa172952ddef29bc: Request end of tablet copy session 776c80c7e044453eb203234ec6e61ab6-e68c8a71dc7b4a9e91ca777dbdf34315 received from {username='slave'} at 127.0.0.1:55880
I20260615 08:08:08.987859 12887 tablet_copy_service.cc:434] P fbae2437fd094047aa172952ddef29bc: ending tablet copy session 776c80c7e044453eb203234ec6e61ab6-e68c8a71dc7b4a9e91ca777dbdf34315 on tablet e68c8a71dc7b4a9e91ca777dbdf34315 with peer 776c80c7e044453eb203234ec6e61ab6
I20260615 08:08:09.276093 12802 raft_consensus.cc:1217] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 3 FOLLOWER]: Deduplicated request from leader. Original: 1.13763->[3.13764-3.14087] Dedup: 3.13867->[3.13868-3.14087]
I20260615 08:08:09.281605 13106 raft_consensus.cc:993] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc: : Instructing follower 776c80c7e044453eb203234ec6e61ab6 to start an election
I20260615 08:08:09.281700 13106 raft_consensus.cc:1081] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [term 3 LEADER]: Signalling peer 776c80c7e044453eb203234ec6e61ab6 to start an election
I20260615 08:08:09.281759 13106 raft_consensus.cc:993] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc: : Instructing follower b0bf7af1b02f48ad802278b5fdf91d51 to start an election
I20260615 08:08:09.281801 13106 raft_consensus.cc:1081] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [term 3 LEADER]: Signalling peer b0bf7af1b02f48ad802278b5fdf91d51 to start an election
I20260615 08:08:09.282083 12802 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e68c8a71dc7b4a9e91ca777dbdf34315"
dest_uuid: "776c80c7e044453eb203234ec6e61ab6"
from {username='slave'} at 127.0.0.1:44122
I20260615 08:08:09.282135 12954 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e68c8a71dc7b4a9e91ca777dbdf34315"
dest_uuid: "b0bf7af1b02f48ad802278b5fdf91d51"
from {username='slave'} at 127.0.0.1:34258
I20260615 08:08:09.282161 12802 raft_consensus.cc:493] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260615 08:08:09.282239 12802 raft_consensus.cc:3060] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 3 FOLLOWER]: Advancing to term 4
W20260615 08:08:09.282362 12843 consensus_peers.cc:409] unable to start election on peer b0bf7af1b02f48ad802278b5fdf91d51: Illegal state: leader elections are disabled
I20260615 08:08:09.283197 12802 raft_consensus.cc:515] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0bf7af1b02f48ad802278b5fdf91d51" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33319 } } peers { permanent_uuid: "fbae2437fd094047aa172952ddef29bc" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 40277 } } peers { permanent_uuid: "776c80c7e044453eb203234ec6e61ab6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40327 } }
I20260615 08:08:09.283392 12802 leader_election.cc:290] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [CANDIDATE]: Term 4 election: Requested vote from peers b0bf7af1b02f48ad802278b5fdf91d51 (127.4.42.195:33319), fbae2437fd094047aa172952ddef29bc (127.4.42.194:40277)
I20260615 08:08:09.283497 12954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e68c8a71dc7b4a9e91ca777dbdf34315" candidate_uuid: "776c80c7e044453eb203234ec6e61ab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 14088 } } ignore_live_leader: true dest_uuid: "b0bf7af1b02f48ad802278b5fdf91d51"
I20260615 08:08:09.283555 12954 raft_consensus.cc:3060] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 [term 3 FOLLOWER]: Advancing to term 4
I20260615 08:08:09.284324 12954 raft_consensus.cc:2468] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 776c80c7e044453eb203234ec6e61ab6 in term 4.
I20260615 08:08:09.283516 12879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e68c8a71dc7b4a9e91ca777dbdf34315" candidate_uuid: "776c80c7e044453eb203234ec6e61ab6" candidate_term: 4 candidate_status { last_received { term: 3 index: 14088 } } ignore_live_leader: true dest_uuid: "fbae2437fd094047aa172952ddef29bc"
I20260615 08:08:09.284410 12879 raft_consensus.cc:3055] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [term 3 LEADER]: Stepping down as leader of term 3
I20260615 08:08:09.284458 12767 leader_election.cc:304] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 776c80c7e044453eb203234ec6e61ab6, b0bf7af1b02f48ad802278b5fdf91d51; no voters:
I20260615 08:08:09.284449 12879 raft_consensus.cc:740] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fbae2437fd094047aa172952ddef29bc, State: Running, Role: LEADER
I20260615 08:08:09.284597 13112 raft_consensus.cc:2804] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 4 FOLLOWER]: Leader election won for term 4
I20260615 08:08:09.284578 12879 consensus_queue.cc:260] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14088, Committed index: 14088, Last appended: 3.14088, Last appended by leader: 14088, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0bf7af1b02f48ad802278b5fdf91d51" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33319 } } peers { permanent_uuid: "fbae2437fd094047aa172952ddef29bc" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 40277 } } peers { permanent_uuid: "776c80c7e044453eb203234ec6e61ab6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40327 } }
I20260615 08:08:09.284667 12879 raft_consensus.cc:3060] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [term 3 FOLLOWER]: Advancing to term 4
I20260615 08:08:09.284687 13112 raft_consensus.cc:697] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 4 LEADER]: Becoming Leader. State: Replica: 776c80c7e044453eb203234ec6e61ab6, State: Running, Role: LEADER
I20260615 08:08:09.284730 13112 consensus_queue.cc:237] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14088, Committed index: 14088, Last appended: 3.14088, Last appended by leader: 14088, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0bf7af1b02f48ad802278b5fdf91d51" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33319 } } peers { permanent_uuid: "fbae2437fd094047aa172952ddef29bc" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 40277 } } peers { permanent_uuid: "776c80c7e044453eb203234ec6e61ab6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40327 } }
I20260615 08:08:09.285344 12879 raft_consensus.cc:2468] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 776c80c7e044453eb203234ec6e61ab6 in term 4.
I20260615 08:08:09.285290 12694 catalog_manager.cc:5696] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 reported cstate change: term changed from 3 to 4, leader changed from fbae2437fd094047aa172952ddef29bc (127.4.42.194) to 776c80c7e044453eb203234ec6e61ab6 (127.4.42.193). New cstate: current_term: 4 leader_uuid: "776c80c7e044453eb203234ec6e61ab6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0bf7af1b02f48ad802278b5fdf91d51" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 33319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbae2437fd094047aa172952ddef29bc" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 40277 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "776c80c7e044453eb203234ec6e61ab6" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40327 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:09.298859 4267 tablet_server.cc:179] TabletServer@127.4.42.193:0 shutting down...
I20260615 08:08:09.301433 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:08:09.301564 4267 tablet_replica.cc:333] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6: stopping tablet replica
I20260615 08:08:09.301613 4267 raft_consensus.cc:2243] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 4 LEADER]: Raft consensus shutting down.
I20260615 08:08:09.301779 4267 pending_rounds.cc:70] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6: Trying to abort 1 pending ops.
I20260615 08:08:09.301807 4267 pending_rounds.cc:77] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6: Aborting op as it isn't in flight: id { term: 4 index: 14089 } timestamp: 7297068602510725120 op_type: NO_OP noop_request { }
I20260615 08:08:09.301836 4267 raft_consensus.cc:2889] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 4 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260615 08:08:09.301853 4267 raft_consensus.cc:2272] T e68c8a71dc7b4a9e91ca777dbdf34315 P 776c80c7e044453eb203234ec6e61ab6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260615 08:08:09.316080 4267 tablet_server.cc:196] TabletServer@127.4.42.193:0 shutdown complete.
I20260615 08:08:09.317018 4267 tablet_server.cc:179] TabletServer@127.4.42.194:0 shutting down...
I20260615 08:08:09.319775 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:08:09.319864 4267 tablet_replica.cc:333] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc: stopping tablet replica
I20260615 08:08:09.319912 4267 raft_consensus.cc:2243] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260615 08:08:09.319952 4267 raft_consensus.cc:2272] T e68c8a71dc7b4a9e91ca777dbdf34315 P fbae2437fd094047aa172952ddef29bc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260615 08:08:09.343101 4267 tablet_server.cc:196] TabletServer@127.4.42.194:0 shutdown complete.
I20260615 08:08:09.343931 4267 tablet_server.cc:179] TabletServer@127.4.42.195:0 shutting down...
I20260615 08:08:09.346490 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:08:09.346613 4267 tablet_replica.cc:333] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51: stopping tablet replica
I20260615 08:08:09.346681 4267 raft_consensus.cc:2243] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260615 08:08:09.346727 4267 raft_consensus.cc:2272] T e68c8a71dc7b4a9e91ca777dbdf34315 P b0bf7af1b02f48ad802278b5fdf91d51 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260615 08:08:09.360119 4267 tablet_server.cc:196] TabletServer@127.4.42.195:0 shutdown complete.
I20260615 08:08:09.361109 4267 master.cc:562] Master@127.4.42.254:39961 shutting down...
I20260615 08:08:09.363746 4267 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1b6b9880b62749819d26b571ceb50fcd [term 1 LEADER]: Raft consensus shutting down.
I20260615 08:08:09.363837 4267 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1b6b9880b62749819d26b571ceb50fcd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:08:09.363870 4267 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1b6b9880b62749819d26b571ceb50fcd: stopping tablet replica
I20260615 08:08:09.375327 4267 master.cc:584] Master@127.4.42.254:39961 shutdown complete.
[ OK ] TxnParticipantITest.TestTxnSystemClientRetriesWhenReplicaNotFound (16230 ms)
[----------] 21 tests from TxnParticipantITest (252300 ms total)
[----------] 2 tests from TxnParticipantElectionStormITest
[ RUN ] TxnParticipantElectionStormITest.TestFrequentElections
I20260615 08:08:09.393873 4267 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.42.254:37165
I20260615 08:08:09.393997 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:08:09.395009 13123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:08:09.395110 13122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:08:09.395077 13125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:08:09.395320 4267 server_base.cc:1061] running on GCE node
I20260615 08:08:09.395454 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:08:09.395481 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:08:09.395493 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510889395494 us; error 0 us; skew 500 ppm
I20260615 08:08:09.396040 4267 webserver.cc:533] Webserver started at http://127.4.42.254:40305/ using document root <none> and password file <none>
I20260615 08:08:09.396136 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:08:09.396183 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:08:09.396229 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:08:09.396493 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/master-0-root/instance:
uuid: "57150f4ea2c148f886adbfcf490def0d"
format_stamp: "Formatted at 2026-06-15 08:08:09 on dist-test-slave-37n8"
I20260615 08:08:09.397367 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:08:09.397805 13130 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:09.397936 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:09.397989 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/master-0-root
uuid: "57150f4ea2c148f886adbfcf490def0d"
format_stamp: "Formatted at 2026-06-15 08:08:09 on dist-test-slave-37n8"
I20260615 08:08:09.398057 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:08:09.409901 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:08:09.410079 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:08:09.412604 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.254:37165
I20260615 08:08:09.424804 13182 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.254:37165 every 8 connection(s)
I20260615 08:08:09.424968 13183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:08:09.425972 13183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d: Bootstrap starting.
I20260615 08:08:09.426262 13183 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d: Neither blocks nor log segments found. Creating new log.
I20260615 08:08:09.426791 13183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d: No bootstrap required, opened a new log
I20260615 08:08:09.426930 13183 raft_consensus.cc:359] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57150f4ea2c148f886adbfcf490def0d" member_type: VOTER }
I20260615 08:08:09.426993 13183 raft_consensus.cc:385] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:08:09.427018 13183 raft_consensus.cc:740] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57150f4ea2c148f886adbfcf490def0d, State: Initialized, Role: FOLLOWER
I20260615 08:08:09.427076 13183 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57150f4ea2c148f886adbfcf490def0d" member_type: VOTER }
I20260615 08:08:09.427116 13183 raft_consensus.cc:399] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260615 08:08:09.427143 13183 raft_consensus.cc:493] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260615 08:08:09.427173 13183 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:08:09.427639 13183 raft_consensus.cc:515] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57150f4ea2c148f886adbfcf490def0d" member_type: VOTER }
I20260615 08:08:09.427713 13183 leader_election.cc:304] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57150f4ea2c148f886adbfcf490def0d; no voters:
I20260615 08:08:09.427819 13183 leader_election.cc:290] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260615 08:08:09.427870 13186 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:08:09.427966 13183 sys_catalog.cc:565] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [sys.catalog]: configured and running, proceeding with master startup.
I20260615 08:08:09.428020 13186 raft_consensus.cc:697] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [term 1 LEADER]: Becoming Leader. State: Replica: 57150f4ea2c148f886adbfcf490def0d, State: Running, Role: LEADER
I20260615 08:08:09.428092 13186 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57150f4ea2c148f886adbfcf490def0d" member_type: VOTER }
I20260615 08:08:09.428324 13186 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57150f4ea2c148f886adbfcf490def0d. Latest consensus state: current_term: 1 leader_uuid: "57150f4ea2c148f886adbfcf490def0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57150f4ea2c148f886adbfcf490def0d" member_type: VOTER } }
I20260615 08:08:09.428414 13186 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [sys.catalog]: This master's current role is: LEADER
I20260615 08:08:09.428355 13187 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "57150f4ea2c148f886adbfcf490def0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57150f4ea2c148f886adbfcf490def0d" member_type: VOTER } }
I20260615 08:08:09.428670 13187 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [sys.catalog]: This master's current role is: LEADER
I20260615 08:08:09.428682 13192 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260615 08:08:09.428884 13192 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260615 08:08:09.429382 4267 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260615 08:08:09.429427 13192 catalog_manager.cc:1382] Generated new cluster ID: f9b128d7772b4ea2bfeaa97c8b08e382
I20260615 08:08:09.429476 13192 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260615 08:08:09.440148 13192 catalog_manager.cc:1405] Generated new certificate authority record
I20260615 08:08:09.440565 13192 catalog_manager.cc:1539] Loading token signing keys...
I20260615 08:08:09.449473 13192 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d: Generated new TSK 0
I20260615 08:08:09.449548 13192 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260615 08:08:09.461163 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260615 08:08:09.461303 4267 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 15
W20260615 08:08:09.462399 13205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:08:09.462459 13207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:08:09.462540 4267 server_base.cc:1061] running on GCE node
W20260615 08:08:09.462477 13204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:08:09.462709 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:08:09.462751 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:08:09.462764 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510889462764 us; error 0 us; skew 500 ppm
I20260615 08:08:09.463302 4267 webserver.cc:533] Webserver started at http://127.4.42.193:45445/ using document root <none> and password file <none>
I20260615 08:08:09.463390 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:08:09.463431 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:08:09.463482 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:08:09.463719 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/ts-0-root/instance:
uuid: "666bbeda390e4798abb1630585e244a1"
format_stamp: "Formatted at 2026-06-15 08:08:09 on dist-test-slave-37n8"
I20260615 08:08:09.464555 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:08:09.465050 13212 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:09.465180 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:09.465251 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/ts-0-root
uuid: "666bbeda390e4798abb1630585e244a1"
format_stamp: "Formatted at 2026-06-15 08:08:09 on dist-test-slave-37n8"
I20260615 08:08:09.465296 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:08:09.488471 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:08:09.488664 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:08:09.488809 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:08:09.489037 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:08:09.489080 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:09.489118 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:08:09.489147 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:09.491786 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.193:40015
I20260615 08:08:09.491809 13275 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.193:40015 every 8 connection(s)
I20260615 08:08:09.492136 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260615 08:08:09.492262 4267 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 15
W20260615 08:08:09.493168 13281 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:08:09.493188 13280 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:08:09.493498 13283 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:08:09.493516 4267 server_base.cc:1061] running on GCE node
I20260615 08:08:09.493655 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:08:09.493710 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:08:09.493739 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510889493739 us; error 0 us; skew 500 ppm
I20260615 08:08:09.494318 4267 webserver.cc:533] Webserver started at http://127.4.42.194:33421/ using document root <none> and password file <none>
I20260615 08:08:09.494410 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:08:09.494446 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:08:09.494530 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:08:09.494788 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/ts-1-root/instance:
uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
format_stamp: "Formatted at 2026-06-15 08:08:09 on dist-test-slave-37n8"
I20260615 08:08:09.495807 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:08:09.496243 13288 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:09.496469 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:09.496532 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/ts-1-root
uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
format_stamp: "Formatted at 2026-06-15 08:08:09 on dist-test-slave-37n8"
I20260615 08:08:09.496577 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:08:09.499114 13276 heartbeater.cc:344] Connected to a master server at 127.4.42.254:37165
I20260615 08:08:09.499178 13276 heartbeater.cc:461] Registering TS with master...
I20260615 08:08:09.499301 13276 heartbeater.cc:507] Master 127.4.42.254:37165 requested a full tablet report, sending...
I20260615 08:08:09.499526 13147 ts_manager.cc:194] Registered new tserver with Master: 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015)
I20260615 08:08:09.500276 13147 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59076
I20260615 08:08:09.506215 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:08:09.506346 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:08:09.506443 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:08:09.506664 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:08:09.506691 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:09.506738 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:08:09.506767 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:09.509358 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.194:38603
I20260615 08:08:09.509431 13351 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.194:38603 every 8 connection(s)
I20260615 08:08:09.509774 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260615 08:08:09.509915 4267 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 15
W20260615 08:08:09.510841 13355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:08:09.510958 13356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:08:09.511128 13358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:08:09.511305 4267 server_base.cc:1061] running on GCE node
I20260615 08:08:09.511447 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:08:09.511492 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:08:09.511513 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510889511513 us; error 0 us; skew 500 ppm
I20260615 08:08:09.512070 4267 webserver.cc:533] Webserver started at http://127.4.42.195:37687/ using document root <none> and password file <none>
I20260615 08:08:09.512148 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:08:09.512192 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:08:09.512245 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:08:09.512567 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/ts-2-root/instance:
uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
format_stamp: "Formatted at 2026-06-15 08:08:09 on dist-test-slave-37n8"
I20260615 08:08:09.512959 13352 heartbeater.cc:344] Connected to a master server at 127.4.42.254:37165
I20260615 08:08:09.513033 13352 heartbeater.cc:461] Registering TS with master...
I20260615 08:08:09.513140 13352 heartbeater.cc:507] Master 127.4.42.254:37165 requested a full tablet report, sending...
I20260615 08:08:09.513370 13147 ts_manager.cc:194] Registered new tserver with Master: d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:09.513690 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260615 08:08:09.513836 13147 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59088
I20260615 08:08:09.514228 13363 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:09.514359 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:09.514410 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/ts-2-root
uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
format_stamp: "Formatted at 2026-06-15 08:08:09 on dist-test-slave-37n8"
I20260615 08:08:09.514465 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:08:09.533589 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:08:09.533803 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:08:09.533963 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:08:09.534170 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:08:09.534222 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:09.534253 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:08:09.534274 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:09.538651 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.195:40159
I20260615 08:08:09.538734 13426 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.195:40159 every 8 connection(s)
I20260615 08:08:09.541939 13427 heartbeater.cc:344] Connected to a master server at 127.4.42.254:37165
I20260615 08:08:09.542019 13427 heartbeater.cc:461] Registering TS with master...
I20260615 08:08:09.542124 13427 heartbeater.cc:507] Master 127.4.42.254:37165 requested a full tablet report, sending...
I20260615 08:08:09.542395 13147 ts_manager.cc:194] Registered new tserver with Master: b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:09.542769 13147 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59100
I20260615 08:08:09.543290 4267 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.004440051s
I20260615 08:08:09.547922 13147 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59106:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260615 08:08:09.548056 13147 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260615 08:08:09.552554 13240 tablet_service.cc:1511] Processing CreateTablet for tablet ad08259deddd40febcaca9a4ceb302d4 (DEFAULT_TABLE table=test-workload [id=4c7106f7a97e4e4aa097c5d4abd55045]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:08:09.552678 13240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad08259deddd40febcaca9a4ceb302d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:08:09.552954 13316 tablet_service.cc:1511] Processing CreateTablet for tablet ad08259deddd40febcaca9a4ceb302d4 (DEFAULT_TABLE table=test-workload [id=4c7106f7a97e4e4aa097c5d4abd55045]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:08:09.553030 13391 tablet_service.cc:1511] Processing CreateTablet for tablet ad08259deddd40febcaca9a4ceb302d4 (DEFAULT_TABLE table=test-workload [id=4c7106f7a97e4e4aa097c5d4abd55045]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:08:09.553072 13316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad08259deddd40febcaca9a4ceb302d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:08:09.553109 13391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad08259deddd40febcaca9a4ceb302d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:08:09.553915 13442 tablet_bootstrap.cc:492] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1: Bootstrap starting.
I20260615 08:08:09.554311 13442 tablet_bootstrap.cc:654] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1: Neither blocks nor log segments found. Creating new log.
I20260615 08:08:09.554443 13444 tablet_bootstrap.cc:492] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c: Bootstrap starting.
I20260615 08:08:09.554999 13444 tablet_bootstrap.cc:654] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c: Neither blocks nor log segments found. Creating new log.
I20260615 08:08:09.555028 13442 tablet_bootstrap.cc:492] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1: No bootstrap required, opened a new log
I20260615 08:08:09.555063 13442 ts_tablet_manager.cc:1403] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260615 08:08:09.555228 13442 raft_consensus.cc:359] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:09.555305 13442 raft_consensus.cc:385] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:08:09.555326 13442 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Initialized, Role: FOLLOWER
I20260615 08:08:09.555351 13443 tablet_bootstrap.cc:492] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f: Bootstrap starting.
I20260615 08:08:09.555397 13442 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:09.555574 13444 tablet_bootstrap.cc:492] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c: No bootstrap required, opened a new log
I20260615 08:08:09.555586 13276 heartbeater.cc:499] Master 127.4.42.254:37165 was elected leader, sending a full tablet report...
I20260615 08:08:09.555656 13444 ts_tablet_manager.cc:1403] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260615 08:08:09.555562 13442 ts_tablet_manager.cc:1434] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260615 08:08:09.555820 13443 tablet_bootstrap.cc:654] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f: Neither blocks nor log segments found. Creating new log.
I20260615 08:08:09.555833 13444 raft_consensus.cc:359] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:09.555912 13444 raft_consensus.cc:385] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:08:09.555930 13444 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Initialized, Role: FOLLOWER
I20260615 08:08:09.555976 13444 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:09.556143 13444 ts_tablet_manager.cc:1434] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260615 08:08:09.556210 13427 heartbeater.cc:499] Master 127.4.42.254:37165 was elected leader, sending a full tablet report...
I20260615 08:08:09.556658 13443 tablet_bootstrap.cc:492] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f: No bootstrap required, opened a new log
I20260615 08:08:09.556710 13443 ts_tablet_manager.cc:1403] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:08:09.556846 13443 raft_consensus.cc:359] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:09.556903 13443 raft_consensus.cc:385] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:08:09.556931 13443 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Initialized, Role: FOLLOWER
I20260615 08:08:09.556962 13443 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:09.557109 13443 ts_tablet_manager.cc:1434] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:09.557113 13352 heartbeater.cc:499] Master 127.4.42.254:37165 was elected leader, sending a full tablet report...
I20260615 08:08:09.559515 13447 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260615 08:08:09.559566 13447 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:09.559733 13447 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:09.562189 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" is_pre_election: true
I20260615 08:08:09.562281 13326 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 0.
I20260615 08:08:09.562297 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" is_pre_election: true
I20260615 08:08:09.562343 13401 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 0.
I20260615 08:08:09.562570 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters:
I20260615 08:08:09.562685 13447 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260615 08:08:09.562749 13447 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:09.562800 13447 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:08:09.563328 13447 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:09.563459 13447 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 1 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:09.563560 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:09.563567 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:09.563650 13326 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:08:09.563659 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:08:09.564314 13401 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 1.
I20260615 08:08:09.564314 13326 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 1.
I20260615 08:08:09.564502 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters:
I20260615 08:08:09.564589 13447 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:08:09.564728 13447 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 1 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:09.564780 13447 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:09.565294 13147 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 666bbeda390e4798abb1630585e244a1 (127.4.42.193). New cstate: current_term: 1 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:09.577811 13326 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 1 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:08:09.577826 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 1 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:08:09.578019 13447 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:08:09.578126 13452 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260615 08:08:19.635551 13468 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20260615 08:08:19.635632 13468 fault_injection.cc:44] THIS SERVER MAY CRASH!
I20260615 08:08:19.705570 13514 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:19.705651 13514 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:08:19.706624 13514 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:19.706842 13514 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 2 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:19.710273 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 14338 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:19.710300 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 14338 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:19.710448 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 2 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 1. Current term is 2. Ops: []
I20260615 08:08:19.710573 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:19.710662 13514 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260615 08:08:19.710651 13481 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 1.14338, Next index: 14339, Last known committed idx: 14338, Time since last communication: 0.000s
I20260615 08:08:19.713311 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 2 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 1. Current term is 2. Ops: [1.14339-1.14339]
I20260615 08:08:19.713506 13481 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 1.14338, Next index: 14339, Last known committed idx: 14338, Time since last communication: 0.000s
I20260615 08:08:19.737059 13468 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 1 LEADER]: Stepping down as leader of term 1
I20260615 08:08:19.737155 13468 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:19.737216 13468 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14339, Committed index: 14339, Last appended: 1.14339, Last appended by leader: 14339, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:19.737390 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:08:19.744117 13514 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:19.744194 13514 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 2 FOLLOWER]: Advancing to term 3
I20260615 08:08:19.744892 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:19.744936 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:08:19.744923 13514 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:19.745123 13514 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 3 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:19.745303 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 14338 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:19.745303 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 3 candidate_status { last_received { term: 1 index: 14338 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:19.745414 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 2 FOLLOWER]: Advancing to term 3
I20260615 08:08:19.745816 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:19.745922 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 2 FOLLOWER]: Advancing to term 3
I20260615 08:08:19.746153 13250 raft_consensus.cc:2410] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for term 3 because replica has last-logged OpId of term: 1 index: 14339, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 14338.
I20260615 08:08:19.746695 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 2 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:19.746711 13325 raft_consensus.cc:2410] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for term 3 because replica has last-logged OpId of term: 1 index: 14339, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 14338.
I20260615 08:08:19.746908 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:19.747026 13514 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260615 08:08:19.749262 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 2 candidate_status { last_received { term: 1 index: 14339 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:19.749364 13250 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 2. Current term is 3.
I20260615 08:08:19.749495 13289 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 2 election: Vote denied by peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 2. Current term is 3.
I20260615 08:08:19.749553 13289 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260615 08:08:19.749604 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 2 candidate_status { last_received { term: 1 index: 14339 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:19.749605 13522 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 2. Current term is 3.
I20260615 08:08:19.749701 13400 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 2. Current term is 3.
I20260615 08:08:19.749836 13289 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 2 election: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 2. Current term is 3.
I20260615 08:08:19.769668 13481 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:19.769723 13481 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 3 FOLLOWER]: Advancing to term 4
I20260615 08:08:19.770510 13481 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:19.770648 13481 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 4 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:19.770860 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 4 candidate_status { last_received { term: 1 index: 14339 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:19.770841 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 4 candidate_status { last_received { term: 1 index: 14339 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:19.770964 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 3 FOLLOWER]: Advancing to term 4
I20260615 08:08:19.771004 13400 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 3 FOLLOWER]: Advancing to term 4
I20260615 08:08:19.771548 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 4.
I20260615 08:08:19.771557 13400 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 4.
I20260615 08:08:19.771733 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters:
I20260615 08:08:19.771854 13481 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 4 FOLLOWER]: Leader election won for term 4
I20260615 08:08:19.771912 13481 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 4 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:19.771975 13481 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14338, Committed index: 14338, Last appended: 1.14339, Last appended by leader: 14339, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:19.772456 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
W20260615 08:08:19.780426 13468 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 4 is higher.
I20260615 08:08:19.797740 13400 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 4 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 14338. Preceding OpId from leader: term: 4 index: 14340. (index mismatch)
I20260615 08:08:19.797998 13481 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14340, Last known committed idx: 14338, Time since last communication: 0.000s
I20260615 08:08:19.803660 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 4 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 14339. Preceding OpId from leader: term: 4 index: 14340. (index mismatch)
I20260615 08:08:19.803864 13481 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14340, Last known committed idx: 14339, Time since last communication: 0.000s
I20260615 08:08:19.896335 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:19.896420 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 4 FOLLOWER]: Advancing to term 5
I20260615 08:08:19.897387 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:19.897536 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 5 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:19.897681 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 5 candidate_status { last_received { term: 4 index: 14341 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:19.897766 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 5 candidate_status { last_received { term: 4 index: 14341 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:19.897941 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:19.898010 13522 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260615 08:08:19.900290 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 5 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 4. Current term is 5. Ops: []
I20260615 08:08:19.900503 13468 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 4.14341, Next index: 14342, Last known committed idx: 14341, Time since last communication: 0.000s
I20260615 08:08:19.916249 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 5 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 4. Current term is 5. Ops: [4.14342-4.14342]
I20260615 08:08:19.916524 13481 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 4.14341, Next index: 14342, Last known committed idx: 14341, Time since last communication: 0.000s
I20260615 08:08:19.942260 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:19.942318 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 5 FOLLOWER]: Advancing to term 6
I20260615 08:08:19.943084 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:19.943205 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 6 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:19.943534 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 6 candidate_status { last_received { term: 4 index: 14341 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:19.944108 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 6 candidate_status { last_received { term: 4 index: 14341 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:19.944350 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:19.944459 13522 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260615 08:08:19.948015 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 6 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 4. Current term is 6. Ops: [4.14342-4.14342]
I20260615 08:08:19.948220 13468 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 4.14341, Next index: 14342, Last known committed idx: 14341, Time since last communication: 0.000s
I20260615 08:08:19.958585 13447 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 4 LEADER]: Stepping down as leader of term 4
I20260615 08:08:19.958659 13447 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:19.958724 13447 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14342, Committed index: 14342, Last appended: 4.14342, Last appended by leader: 14342, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:19.958832 13447 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 4 FOLLOWER]: Advancing to term 5
I20260615 08:08:19.975534 13514 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:19.975647 13514 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 4 FOLLOWER]: Advancing to term 5
I20260615 08:08:19.976265 13514 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:19.976442 13514 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 5 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:19.976665 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 14342 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:19.976698 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 5 candidate_status { last_received { term: 4 index: 14342 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:19.976760 13325 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 5. Current term is 6.
I20260615 08:08:19.976902 13366 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 5 election: Vote denied by peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 5. Current term is 6.
I20260615 08:08:19.976936 13366 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260615 08:08:19.976994 13514 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 5 FOLLOWER]: Advancing to term 6
I20260615 08:08:19.977406 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 5.
I20260615 08:08:19.977583 13514 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 5. Current term is 6.
I20260615 08:08:19.989871 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:19.989934 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 6 FOLLOWER]: Advancing to term 7
I20260615 08:08:19.990633 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:19.990765 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 7 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:19.990911 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 7 candidate_status { last_received { term: 4 index: 14341 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:19.990967 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 7 candidate_status { last_received { term: 4 index: 14341 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:19.990983 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 5 FOLLOWER]: Advancing to term 7
I20260615 08:08:19.991046 13400 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 6 FOLLOWER]: Advancing to term 7
I20260615 08:08:19.991546 13400 raft_consensus.cc:2410] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for term 7 because replica has last-logged OpId of term: 4 index: 14342, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 14341.
I20260615 08:08:19.991710 13250 raft_consensus.cc:2410] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for term 7 because replica has last-logged OpId of term: 4 index: 14342, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 14341.
I20260615 08:08:19.991873 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:19.991982 13522 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260615 08:08:20.008231 13497 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:20.008303 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 7 FOLLOWER]: Advancing to term 8
I20260615 08:08:20.008872 13514 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:20.008960 13514 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 7 FOLLOWER]: Advancing to term 8
I20260615 08:08:20.009056 13497 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.009207 13497 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 8 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:20.009377 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 8 candidate_status { last_received { term: 4 index: 14342 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:20.009387 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 8 candidate_status { last_received { term: 4 index: 14342 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:20.009473 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 7 FOLLOWER]: Advancing to term 8
I20260615 08:08:20.009763 13514 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.009912 13514 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 8 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:20.009933 13400 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 in current term 8: Already voted for candidate b97b73a5f2ad444eb230680e3c3fcb6c in this term.
I20260615 08:08:20.010054 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 8.
I20260615 08:08:20.010201 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters: b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:20.010207 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 8 candidate_status { last_received { term: 4 index: 14342 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:20.010236 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 8 candidate_status { last_received { term: 4 index: 14342 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:20.010313 13250 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c in current term 8: Already voted for candidate 666bbeda390e4798abb1630585e244a1 in this term.
I20260615 08:08:20.010335 13325 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c in current term 8: Already voted for candidate 666bbeda390e4798abb1630585e244a1 in this term.
I20260615 08:08:20.010355 13497 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 8 FOLLOWER]: Leader election won for term 8
I20260615 08:08:20.010401 13497 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 8 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:20.010448 13497 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14341, Committed index: 14341, Last appended: 4.14342, Last appended by leader: 14342, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.010571 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:20.010665 13514 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260615 08:08:20.010946 13146 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
W20260615 08:08:20.018671 13447 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 8 is higher.
I20260615 08:08:20.035272 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 8 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 4 index: 14341. Preceding OpId from leader: term: 8 index: 14343. (index mismatch)
I20260615 08:08:20.035547 13497 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14343, Last known committed idx: 14341, Time since last communication: 0.000s
I20260615 08:08:20.042372 13400 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 8 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 4 index: 14342. Preceding OpId from leader: term: 8 index: 14343. (index mismatch)
I20260615 08:08:20.042616 13497 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14343, Last known committed idx: 14342, Time since last communication: 0.000s
W20260615 08:08:20.075017 13481 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 8 is higher.
I20260615 08:08:20.082253 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:20.082334 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 8 FOLLOWER]: Advancing to term 9
I20260615 08:08:20.083149 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.083290 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 9 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:20.083433 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 9 candidate_status { last_received { term: 8 index: 14344 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:20.083455 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 9 candidate_status { last_received { term: 8 index: 14344 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:20.083681 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:20.083786 13522 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260615 08:08:20.086879 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 9 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 8. Current term is 9. Ops: []
I20260615 08:08:20.087111 13447 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 8.14344, Next index: 14345, Last known committed idx: 14344, Time since last communication: 0.000s
I20260615 08:08:20.115250 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 9 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 8. Current term is 9. Ops: []
I20260615 08:08:20.115486 13481 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 8.14344, Next index: 14345, Last known committed idx: 14344, Time since last communication: 0.000s
I20260615 08:08:20.118247 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:20.118319 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 9 FOLLOWER]: Advancing to term 10
I20260615 08:08:20.118851 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.118979 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 10 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:20.119114 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 10 candidate_status { last_received { term: 8 index: 14344 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:20.119118 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 10 candidate_status { last_received { term: 8 index: 14344 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:20.119321 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:20.119402 13522 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260615 08:08:20.134606 13514 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:20.134684 13514 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 8 FOLLOWER]: Advancing to term 9
I20260615 08:08:20.135217 13514 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.135325 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 9 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 8. Current term is 9. Ops: []
I20260615 08:08:20.135383 13514 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 9 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:20.135493 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 14344 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:20.135569 13497 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 8.14344, Next index: 14345, Last known committed idx: 14344, Time since last communication: 0.000s
I20260615 08:08:20.135535 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 9 candidate_status { last_received { term: 8 index: 14344 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:20.135749 13325 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 9. Current term is 10.
I20260615 08:08:20.135913 13366 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 9 election: Vote denied by peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 9. Current term is 10.
I20260615 08:08:20.135953 13366 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260615 08:08:20.136029 13514 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 9 FOLLOWER]: Advancing to term 10
I20260615 08:08:20.136529 13514 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 9. Current term is 10.
I20260615 08:08:20.149367 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 10 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 8. Current term is 10. Ops: []
I20260615 08:08:20.149626 13447 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 8.14344, Next index: 14345, Last known committed idx: 14344, Time since last communication: 0.000s
I20260615 08:08:20.171588 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 10 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 8. Current term is 10. Ops: []
I20260615 08:08:20.171804 13481 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 8.14344, Next index: 14345, Last known committed idx: 14344, Time since last communication: 0.000s
I20260615 08:08:20.177299 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 10 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 8. Current term is 10. Ops: [8.14345-8.14345]
I20260615 08:08:20.177343 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 10 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 8. Current term is 10. Ops: [8.14345-8.14345]
I20260615 08:08:20.177533 13447 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 8.14344, Next index: 14345, Last known committed idx: 14344, Time since last communication: 0.000s
I20260615 08:08:20.177627 13481 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 8.14344, Next index: 14345, Last known committed idx: 14344, Time since last communication: 0.000s
I20260615 08:08:20.180840 13514 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:20.180899 13514 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 10 FOLLOWER]: Advancing to term 11
I20260615 08:08:20.181770 13514 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.181924 13514 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 11 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:20.182036 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 11 candidate_status { last_received { term: 8 index: 14344 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:20.182201 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 11 candidate_status { last_received { term: 8 index: 14344 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:20.182260 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 10 FOLLOWER]: Advancing to term 11
I20260615 08:08:20.182835 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 11.
I20260615 08:08:20.182989 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1
I20260615 08:08:20.183073 13514 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 11 FOLLOWER]: Leader election won for term 11
I20260615 08:08:20.183229 13514 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 11 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:20.183290 13514 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14344, Committed index: 14344, Last appended: 8.14344, Last appended by leader: 14344, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.183785 13146 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 8 to 11, leader changed from 666bbeda390e4798abb1630585e244a1 (127.4.42.193) to b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195). New cstate: current_term: 11 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:20.200881 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 11 LEADER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 8. Current term is 11. Ops: [8.14345-8.14345]
I20260615 08:08:20.201085 13447 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 8.14344, Next index: 14345, Last known committed idx: 14344, Time since last communication: 0.000s
I20260615 08:08:20.201164 13447 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer b97b73a5f2ad444eb230680e3c3fcb6c log is divergent from this leader: its last log entry 11.14345 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14344
I20260615 08:08:20.213070 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 11 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 8. Current term is 11. Ops: [8.14345-8.14345]
I20260615 08:08:20.213289 13447 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 8.14344, Next index: 14345, Last known committed idx: 14344, Time since last communication: 0.000s
I20260615 08:08:20.213421 13250 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 8 LEADER]: Stepping down as leader of term 8
I20260615 08:08:20.213469 13250 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:20.213533 13250 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14344, Committed index: 14344, Last appended: 8.14345, Last appended by leader: 14345, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.213635 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 8 FOLLOWER]: Advancing to term 11
I20260615 08:08:20.214169 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 11 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 8 index: 14345. Preceding OpId from leader: term: 11 index: 14345. (term mismatch)
I20260615 08:08:20.214205 13250 pending_rounds.cc:85] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1: Aborting all ops after (but not including) 14344
I20260615 08:08:20.214217 13250 pending_rounds.cc:107] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1: Aborting uncommitted PARTICIPANT_OP operation due to leader change: 8.14345
I20260615 08:08:20.214445 13514 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14345, Last known committed idx: 14344, Time since last communication: 0.000s
I20260615 08:08:20.215021 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 11 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 8 index: 14344. Preceding OpId from leader: term: 11 index: 14346. (index mismatch)
I20260615 08:08:20.215291 13555 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14345, Last known committed idx: 14344, Time since last communication: 0.000s
I20260615 08:08:20.277149 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 11 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:20.277244 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 11 FOLLOWER]: Advancing to term 12
I20260615 08:08:20.277832 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.278035 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 12 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:20.278190 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 12 candidate_status { last_received { term: 11 index: 14346 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:20.278209 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 12 candidate_status { last_received { term: 11 index: 14346 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:20.278479 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:20.278617 13522 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260615 08:08:20.282558 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 12 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 11. Current term is 12. Ops: []
I20260615 08:08:20.282774 13514 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 11.14346, Next index: 14347, Last known committed idx: 14346, Time since last communication: 0.000s
I20260615 08:08:20.307442 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 12 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 11. Current term is 12. Ops: [11.14347-11.14347]
I20260615 08:08:20.307711 13563 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 11.14346, Next index: 14347, Last known committed idx: 14346, Time since last communication: 0.000s
I20260615 08:08:20.312731 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:20.312786 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 12 FOLLOWER]: Advancing to term 13
I20260615 08:08:20.313299 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.313445 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 13 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:20.313580 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 13 candidate_status { last_received { term: 11 index: 14346 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:20.313577 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 13 candidate_status { last_received { term: 11 index: 14346 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:20.313825 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:20.313943 13522 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260615 08:08:20.337249 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 13 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 11. Current term is 13. Ops: [11.14347-11.14347]
I20260615 08:08:20.337460 13555 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 11.14346, Next index: 14347, Last known committed idx: 14346, Time since last communication: 0.000s
I20260615 08:08:20.339069 13481 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:20.339116 13481 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 11 FOLLOWER]: Advancing to term 12
I20260615 08:08:20.339808 13481 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.339991 13481 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 12 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:20.340106 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 12 candidate_status { last_received { term: 11 index: 14347 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:20.340116 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 12 candidate_status { last_received { term: 11 index: 14347 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:20.340188 13325 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 12. Current term is 13.
I20260615 08:08:20.340333 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 12 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 11. Current term is 12. Ops: []
I20260615 08:08:20.340370 13215 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 12 election: Vote denied by peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 12. Current term is 13.
I20260615 08:08:20.340452 13215 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260615 08:08:20.340525 13481 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 12 FOLLOWER]: Advancing to term 13
I20260615 08:08:20.340596 13514 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 11.14347, Next index: 14348, Last known committed idx: 14347, Time since last communication: 0.000s
I20260615 08:08:20.341248 13481 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 12. Current term is 13.
I20260615 08:08:20.347322 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:20.347378 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 13 FOLLOWER]: Advancing to term 14
I20260615 08:08:20.347869 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.347990 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 14 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:20.348120 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 14 candidate_status { last_received { term: 11 index: 14346 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:20.348156 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 14 candidate_status { last_received { term: 11 index: 14346 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:20.348207 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 13 FOLLOWER]: Advancing to term 14
I20260615 08:08:20.348857 13250 raft_consensus.cc:2410] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for term 14 because replica has last-logged OpId of term: 11 index: 14347, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 14346.
I20260615 08:08:20.349036 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:20.349205 13522 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260615 08:08:20.368873 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 14 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 11. Current term is 14. Ops: [11.14347-11.14347]
I20260615 08:08:20.369099 13555 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 11.14346, Next index: 14347, Last known committed idx: 14346, Time since last communication: 0.000s
I20260615 08:08:20.370203 13563 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 11 LEADER]: Stepping down as leader of term 11
I20260615 08:08:20.370261 13563 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:20.370347 13563 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14347, Committed index: 14347, Last appended: 11.14347, Last appended by leader: 14347, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.370452 13563 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 11 FOLLOWER]: Advancing to term 12
I20260615 08:08:20.385386 13481 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:20.385442 13481 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 14 FOLLOWER]: Advancing to term 15
I20260615 08:08:20.385924 13481 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.386063 13481 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 15 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:20.386205 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 15 candidate_status { last_received { term: 11 index: 14347 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:20.386229 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 15 candidate_status { last_received { term: 11 index: 14347 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:20.386279 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 14 FOLLOWER]: Advancing to term 15
I20260615 08:08:20.386346 13400 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 12 FOLLOWER]: Advancing to term 15
I20260615 08:08:20.386926 13400 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 15.
I20260615 08:08:20.387059 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 15.
I20260615 08:08:20.387138 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters:
I20260615 08:08:20.387228 13481 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 15 FOLLOWER]: Leader election won for term 15
I20260615 08:08:20.387269 13481 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 15 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:20.387315 13481 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14347, Committed index: 14347, Last appended: 11.14347, Last appended by leader: 14347, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
W20260615 08:08:20.387552 13497 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 15 is higher.
I20260615 08:08:20.387796 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 11 to 15, leader changed from b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195) to 666bbeda390e4798abb1630585e244a1 (127.4.42.193). New cstate: current_term: 15 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:20.413954 13400 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 15 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 11 index: 14347. Preceding OpId from leader: term: 15 index: 14348. (index mismatch)
I20260615 08:08:20.414160 13481 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14348, Last known committed idx: 14347, Time since last communication: 0.000s
I20260615 08:08:20.415416 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 15 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 11 index: 14346. Preceding OpId from leader: term: 15 index: 14349. (index mismatch)
I20260615 08:08:20.415617 13468 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14348, Last known committed idx: 14346, Time since last communication: 0.000s
W20260615 08:08:20.415724 13497 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 15 is higher.
I20260615 08:08:20.475008 13555 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:20.475067 13555 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 15 FOLLOWER]: Advancing to term 16
I20260615 08:08:20.475711 13555 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.475860 13555 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 16 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:20.476011 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14349 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:20.476009 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 16 candidate_status { last_received { term: 15 index: 14349 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:20.476253 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:20.476367 13555 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260615 08:08:20.476527 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 16 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 15. Current term is 16. Ops: []
I20260615 08:08:20.476761 13497 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 15.14349, Next index: 14350, Last known committed idx: 14349, Time since last communication: 0.000s
I20260615 08:08:20.504907 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 16 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 15. Current term is 16. Ops: []
I20260615 08:08:20.505134 13447 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 15.14349, Next index: 14350, Last known committed idx: 14349, Time since last communication: 0.000s
I20260615 08:08:20.507022 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 16 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 15. Current term is 16. Ops: [15.14350-15.14350]
I20260615 08:08:20.507422 13447 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 15.14349, Next index: 14350, Last known committed idx: 14349, Time since last communication: 0.000s
I20260615 08:08:20.510706 13563 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:20.510757 13563 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 16 FOLLOWER]: Advancing to term 17
I20260615 08:08:20.511484 13563 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.511616 13563 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 17 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:20.511718 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 17 candidate_status { last_received { term: 15 index: 14349 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:20.511762 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 17 candidate_status { last_received { term: 15 index: 14349 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:20.511947 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:20.512068 13563 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260615 08:08:20.542080 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 17 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 15. Current term is 17. Ops: [15.14350-15.14350]
I20260615 08:08:20.542325 13468 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 15.14349, Next index: 14350, Last known committed idx: 14349, Time since last communication: 0.000s
I20260615 08:08:20.547585 13497 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 15 LEADER]: Stepping down as leader of term 15
I20260615 08:08:20.547643 13497 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:20.547704 13497 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14350, Committed index: 14350, Last appended: 15.14350, Last appended by leader: 14350, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.547808 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 15 FOLLOWER]: Advancing to term 16
I20260615 08:08:20.562855 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:20.562914 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 15 FOLLOWER]: Advancing to term 16
I20260615 08:08:20.563432 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.563597 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 16 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:20.563802 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14350 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:20.564591 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 16.
I20260615 08:08:20.564679 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14350 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:20.564735 13400 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 16. Current term is 17.
I20260615 08:08:20.564765 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters:
I20260615 08:08:20.564898 13522 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 16 FOLLOWER]: Leader election won for term 16
I20260615 08:08:20.564953 13289 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 16 election: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 16. Current term is 17.
I20260615 08:08:20.565052 13522 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 16 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:20.565105 13522 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14350, Committed index: 14350, Last appended: 15.14350, Last appended by leader: 14350, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.565555 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 15 to 16, leader changed from 666bbeda390e4798abb1630585e244a1 (127.4.42.193) to d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194). New cstate: current_term: 16 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:20.567621 13563 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:20.567687 13563 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 17 FOLLOWER]: Advancing to term 18
I20260615 08:08:20.568207 13563 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.568356 13563 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 18 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:20.568483 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 18 candidate_status { last_received { term: 15 index: 14349 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:20.568480 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 18 candidate_status { last_received { term: 15 index: 14349 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:20.568575 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 16 FOLLOWER]: Advancing to term 18
I20260615 08:08:20.569036 13250 raft_consensus.cc:2410] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for term 18 because replica has last-logged OpId of term: 15 index: 14350, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 14349.
I20260615 08:08:20.569173 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:20.569272 13563 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260615 08:08:20.592787 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 18 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 16. Current term is 18. Ops: []
I20260615 08:08:20.593060 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 18 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 16. Current term is 18. Ops: []
I20260615 08:08:20.593042 13522 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14351, Last known committed idx: 14349, Time since last communication: 0.000s
I20260615 08:08:20.593297 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14351, Last known committed idx: 14350, Time since last communication: 0.000s
I20260615 08:08:20.595207 13522 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 16 LEADER]: Stepping down as leader of term 16
I20260615 08:08:20.595247 13522 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:20.595304 13522 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14350, Committed index: 14350, Last appended: 16.14351, Last appended by leader: 14351, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.595379 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 16 FOLLOWER]: Advancing to term 18
I20260615 08:08:20.602200 13447 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:20.602281 13447 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 18 FOLLOWER]: Advancing to term 19
I20260615 08:08:20.602846 13447 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.603011 13447 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 19 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:20.603132 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 19 candidate_status { last_received { term: 15 index: 14350 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:20.603140 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 19 candidate_status { last_received { term: 15 index: 14350 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:20.603209 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 18 FOLLOWER]: Advancing to term 19
I20260615 08:08:20.603255 13400 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 18 FOLLOWER]: Advancing to term 19
I20260615 08:08:20.603737 13400 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 19.
I20260615 08:08:20.603914 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters:
I20260615 08:08:20.603917 13325 raft_consensus.cc:2410] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for term 19 because replica has last-logged OpId of term: 16 index: 14351, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 14350.
I20260615 08:08:20.604005 13447 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 19 FOLLOWER]: Leader election won for term 19
I20260615 08:08:20.604058 13447 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 19 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:20.604118 13447 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14349, Committed index: 14349, Last appended: 15.14350, Last appended by leader: 14350, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.604610 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 16 to 19, leader changed from d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194) to 666bbeda390e4798abb1630585e244a1 (127.4.42.193). New cstate: current_term: 19 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
W20260615 08:08:20.606544 13497 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 19 is higher.
I20260615 08:08:20.622438 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:20.622546 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 19 FOLLOWER]: Advancing to term 20
I20260615 08:08:20.623250 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.623384 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 20 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:20.623598 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 20 candidate_status { last_received { term: 16 index: 14351 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:20.623723 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 20 candidate_status { last_received { term: 16 index: 14351 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:20.623778 13400 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 19 FOLLOWER]: Advancing to term 20
I20260615 08:08:20.624257 13400 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 20.
I20260615 08:08:20.624432 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1
I20260615 08:08:20.624514 13522 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 20 FOLLOWER]: Leader election won for term 20
I20260615 08:08:20.624567 13522 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 20 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:20.624615 13522 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14350, Committed index: 14350, Last appended: 16.14351, Last appended by leader: 14351, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.628294 13146 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 19 to 20, leader changed from 666bbeda390e4798abb1630585e244a1 (127.4.42.193) to d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194). New cstate: current_term: 20 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:20.629712 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 20 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 19. Current term is 20. Ops: []
I20260615 08:08:20.629936 13447 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14351, Last known committed idx: 14349, Time since last communication: 0.000s
I20260615 08:08:20.635663 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 20 LEADER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 19. Current term is 20. Ops: []
I20260615 08:08:20.635888 13447 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14351, Last known committed idx: 14350, Time since last communication: 0.000s
I20260615 08:08:20.635970 13447 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer d4d7c2ebbf334b19a7f964aab04f280f log is divergent from this leader: its last log entry 20.14352 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14350
I20260615 08:08:20.648156 13250 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 19 LEADER]: Stepping down as leader of term 19
I20260615 08:08:20.648216 13250 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:20.648269 13250 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14349, Committed index: 14349, Last appended: 19.14351, Last appended by leader: 14351, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.648373 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 19 FOLLOWER]: Advancing to term 20
I20260615 08:08:20.648833 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 20 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14351. Preceding OpId from leader: term: 20 index: 14352. (index mismatch)
I20260615 08:08:20.649075 13522 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14352, Last known committed idx: 14349, Time since last communication: 0.000s
I20260615 08:08:20.649137 13522 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer 666bbeda390e4798abb1630585e244a1 log is divergent from this leader: its last log entry 19.14351 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14349
I20260615 08:08:20.649370 13250 raft_consensus.cc:1217] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 20 FOLLOWER]: Deduplicated request from leader. Original: 15.14349->[15.14350-20.14352] Dedup: 15.14350->[16.14351-20.14352]
I20260615 08:08:20.649425 13250 pending_rounds.cc:85] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1: Aborting all ops after (but not including) 14350
I20260615 08:08:20.649448 13250 pending_rounds.cc:107] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1: Aborting uncommitted NO_OP operation due to leader change: 19.14351
I20260615 08:08:20.649477 13250 raft_consensus.cc:2889] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260615 08:08:20.650195 13400 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 20 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 15 index: 14349. Preceding OpId from leader: term: 20 index: 14353. (index mismatch)
I20260615 08:08:20.650591 13522 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14352, Last known committed idx: 14349, Time since last communication: 0.000s
I20260615 08:08:20.681754 13468 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 20 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:20.681843 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 20 FOLLOWER]: Advancing to term 21
I20260615 08:08:20.682358 13468 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.682560 13468 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 21 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:20.682677 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 21 candidate_status { last_received { term: 20 index: 14353 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:20.682679 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 21 candidate_status { last_received { term: 20 index: 14353 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:20.682942 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:20.683043 13468 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260615 08:08:20.684342 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 21 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 20. Current term is 21. Ops: []
I20260615 08:08:20.684566 13584 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 20.14353, Next index: 14354, Last known committed idx: 14353, Time since last communication: 0.000s
I20260615 08:08:20.708689 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 21 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 20. Current term is 21. Ops: []
I20260615 08:08:20.708948 13584 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 20.14353, Next index: 14354, Last known committed idx: 14353, Time since last communication: 0.000s
I20260615 08:08:20.715466 13497 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:20.715515 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 21 FOLLOWER]: Advancing to term 22
I20260615 08:08:20.716064 13497 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.716207 13497 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 22 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:20.716336 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 22 candidate_status { last_received { term: 20 index: 14353 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:20.716336 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 22 candidate_status { last_received { term: 20 index: 14353 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:20.716593 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:20.716688 13497 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260615 08:08:20.728263 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 22 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 20. Current term is 22. Ops: [20.14354-20.14354]
I20260615 08:08:20.728461 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 20.14353, Next index: 14354, Last known committed idx: 14353, Time since last communication: 0.000s
I20260615 08:08:20.750048 13497 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:20.750123 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 22 FOLLOWER]: Advancing to term 23
I20260615 08:08:20.750926 13497 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.751086 13497 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 23 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:20.751209 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 23 candidate_status { last_received { term: 20 index: 14353 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:20.751230 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 23 candidate_status { last_received { term: 20 index: 14353 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:20.751431 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:20.751528 13497 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260615 08:08:20.757936 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 23 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 20. Current term is 23. Ops: [20.14354-20.14354]
I20260615 08:08:20.758168 13522 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 20.14353, Next index: 14354, Last known committed idx: 14353, Time since last communication: 0.000s
I20260615 08:08:20.767872 13584 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 20 LEADER]: Stepping down as leader of term 20
I20260615 08:08:20.767939 13584 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:20.768013 13584 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14354, Committed index: 14354, Last appended: 20.14354, Last appended by leader: 14354, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.768123 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 20 FOLLOWER]: Advancing to term 21
I20260615 08:08:20.786111 13563 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 20 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:20.786172 13563 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 20 FOLLOWER]: Advancing to term 21
I20260615 08:08:20.786785 13563 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.786929 13563 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 21 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:20.787115 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14354 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:20.787115 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14354 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:20.787240 13250 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 21. Current term is 23.
I20260615 08:08:20.787434 13364 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 21 election: Vote denied by peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 21. Current term is 23.
I20260615 08:08:20.787482 13364 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260615 08:08:20.787540 13563 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 21 FOLLOWER]: Advancing to term 23
I20260615 08:08:20.787772 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 21.
I20260615 08:08:20.788069 13563 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 23 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 21. Current term is 23.
I20260615 08:08:20.808743 13497 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:20.808822 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 23 FOLLOWER]: Advancing to term 24
I20260615 08:08:20.809409 13497 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.809581 13497 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 24 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:20.809801 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 24 candidate_status { last_received { term: 20 index: 14353 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:20.809801 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 24 candidate_status { last_received { term: 20 index: 14353 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:20.809952 13400 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 23 FOLLOWER]: Advancing to term 24
I20260615 08:08:20.809942 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 21 FOLLOWER]: Advancing to term 24
I20260615 08:08:20.810637 13325 raft_consensus.cc:2410] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for term 24 because replica has last-logged OpId of term: 20 index: 14354, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14353.
I20260615 08:08:20.810637 13400 raft_consensus.cc:2410] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for term 24 because replica has last-logged OpId of term: 20 index: 14354, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14353.
I20260615 08:08:20.810868 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:20.810976 13497 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260615 08:08:20.821123 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:20.821182 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 24 FOLLOWER]: Advancing to term 25
I20260615 08:08:20.821698 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.821852 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 25 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:20.822088 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 25 candidate_status { last_received { term: 20 index: 14354 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:20.822139 13400 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 24 FOLLOWER]: Advancing to term 25
I20260615 08:08:20.822062 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 25 candidate_status { last_received { term: 20 index: 14354 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:20.822188 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 24 FOLLOWER]: Advancing to term 25
I20260615 08:08:20.822710 13400 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 25.
I20260615 08:08:20.822779 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 25.
I20260615 08:08:20.822901 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f; no voters:
I20260615 08:08:20.822999 13522 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 25 FOLLOWER]: Leader election won for term 25
I20260615 08:08:20.823063 13522 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 25 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:20.823113 13522 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14353, Committed index: 14353, Last appended: 20.14354, Last appended by leader: 14354, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.823593 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 20 to 25. New cstate: current_term: 25 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:20.847702 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 25 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 20 index: 14353. Preceding OpId from leader: term: 25 index: 14355. (index mismatch)
I20260615 08:08:20.847934 13522 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14355, Last known committed idx: 14353, Time since last communication: 0.000s
W20260615 08:08:20.849004 13584 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 22 current term: 25 is higher.
I20260615 08:08:20.854907 13400 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 25 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 20 index: 14354. Preceding OpId from leader: term: 25 index: 14355. (index mismatch)
I20260615 08:08:20.855132 13522 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14355, Last known committed idx: 14354, Time since last communication: 0.000s
I20260615 08:08:20.886469 13563 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 25 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:20.886581 13563 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 25 FOLLOWER]: Advancing to term 26
I20260615 08:08:20.887305 13563 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.887418 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 26 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 25. Current term is 26. Ops: []
I20260615 08:08:20.887466 13563 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 26 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:20.887583 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 26 candidate_status { last_received { term: 25 index: 14355 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:20.887619 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 25.14355, Next index: 14356, Last known committed idx: 14355, Time since last communication: 0.000s
I20260615 08:08:20.887612 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 26 candidate_status { last_received { term: 25 index: 14355 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:20.887897 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:20.888008 13563 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260615 08:08:20.904395 13580 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 23 current term: 25 is higher.
I20260615 08:08:20.911518 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 26 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 25. Current term is 26. Ops: []
I20260615 08:08:20.911729 13584 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 25.14355, Next index: 14356, Last known committed idx: 14355, Time since last communication: 0.000s
I20260615 08:08:20.929418 13563 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:20.929493 13563 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 26 FOLLOWER]: Advancing to term 27
I20260615 08:08:20.930166 13563 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.930346 13563 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 27 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:20.930476 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 27 candidate_status { last_received { term: 25 index: 14355 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:20.930481 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 27 candidate_status { last_received { term: 25 index: 14355 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:20.930812 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:20.930948 13563 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260615 08:08:20.938884 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 27 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 25. Current term is 27. Ops: []
I20260615 08:08:20.939064 13522 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 25.14355, Next index: 14356, Last known committed idx: 14355, Time since last communication: 0.000s
I20260615 08:08:20.943141 13580 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 25 LEADER]: Stepping down as leader of term 25
I20260615 08:08:20.943192 13580 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 25 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:20.943276 13580 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14355, Committed index: 14355, Last appended: 25.14355, Last appended by leader: 14355, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.943372 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 25 FOLLOWER]: Advancing to term 26
I20260615 08:08:20.956138 13497 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 25 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:20.956202 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 25 FOLLOWER]: Advancing to term 26
I20260615 08:08:20.956715 13497 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.956866 13497 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 26 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:20.957027 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 26 candidate_status { last_received { term: 25 index: 14355 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:20.957077 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 26 candidate_status { last_received { term: 25 index: 14355 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:20.957167 13400 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 26. Current term is 27.
I20260615 08:08:20.957340 13213 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 26 election: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 26. Current term is 27.
I20260615 08:08:20.957373 13213 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 26 election: Cancelling election due to peer responding with higher term
I20260615 08:08:20.957445 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 26 FOLLOWER]: Advancing to term 27
I20260615 08:08:20.957746 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 26.
I20260615 08:08:20.957973 13497 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 27 FOLLOWER]: Leader election lost for term 26. Reason: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 26. Current term is 27.
I20260615 08:08:20.979391 13563 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:20.979455 13563 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 27 FOLLOWER]: Advancing to term 28
I20260615 08:08:20.979991 13563 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.980139 13563 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 28 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:20.980309 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 28 candidate_status { last_received { term: 25 index: 14355 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:20.980319 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 28 candidate_status { last_received { term: 25 index: 14355 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:20.980408 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 27 FOLLOWER]: Advancing to term 28
I20260615 08:08:20.980412 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 26 FOLLOWER]: Advancing to term 28
I20260615 08:08:20.980901 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 28.
I20260615 08:08:20.981065 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 28.
I20260615 08:08:20.981081 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f; no voters:
I20260615 08:08:20.981191 13563 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 28 FOLLOWER]: Leader election won for term 28
I20260615 08:08:20.981240 13563 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 28 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:20.981282 13563 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14355, Committed index: 14355, Last appended: 25.14355, Last appended by leader: 14355, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:20.981724 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 25 to 28, leader changed from d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194) to b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195). New cstate: current_term: 28 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:21.010222 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 28 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 25 index: 14355. Preceding OpId from leader: term: 28 index: 14356. (index mismatch)
I20260615 08:08:21.010435 13563 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14356, Last known committed idx: 14355, Time since last communication: 0.000s
I20260615 08:08:21.011466 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 28 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 25 index: 14355. Preceding OpId from leader: term: 28 index: 14356. (index mismatch)
I20260615 08:08:21.011650 13563 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14356, Last known committed idx: 14355, Time since last communication: 0.000s
I20260615 08:08:21.090996 13580 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 28 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:21.091099 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 28 FOLLOWER]: Advancing to term 29
I20260615 08:08:21.092671 13580 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.092828 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 29 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 28. Current term is 29. Ops: []
I20260615 08:08:21.092922 13580 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 29 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:21.093112 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 29 candidate_status { last_received { term: 28 index: 14356 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:21.093112 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 29 candidate_status { last_received { term: 28 index: 14356 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:21.093199 13563 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 28.14356, Next index: 14357, Last known committed idx: 14356, Time since last communication: 0.000s
I20260615 08:08:21.093376 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:21.093454 13580 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260615 08:08:21.104391 13555 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 28 LEADER]: Stepping down as leader of term 28
I20260615 08:08:21.104437 13555 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 28 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:21.104478 13555 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14356, Committed index: 14356, Last appended: 28.14356, Last appended by leader: 14356, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.104604 13555 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 28 FOLLOWER]: Advancing to term 29
I20260615 08:08:21.130555 13497 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 28 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:21.130623 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 28 FOLLOWER]: Advancing to term 29
I20260615 08:08:21.131222 13497 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.131376 13497 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 29 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:21.131531 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 29 candidate_status { last_received { term: 28 index: 14356 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:21.131544 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 29 candidate_status { last_received { term: 28 index: 14356 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:21.131639 13325 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 in current term 29: Already voted for candidate d4d7c2ebbf334b19a7f964aab04f280f in this term.
I20260615 08:08:21.132174 13400 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 29.
I20260615 08:08:21.132351 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters: d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:21.132448 13497 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 29 FOLLOWER]: Leader election won for term 29
I20260615 08:08:21.132507 13497 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 29 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:21.132576 13497 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14356, Committed index: 14356, Last appended: 28.14356, Last appended by leader: 14356, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.133008 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 28 to 29, leader changed from b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195) to 666bbeda390e4798abb1630585e244a1 (127.4.42.193). New cstate: current_term: 29 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:21.135869 13580 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:21.135913 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 29 FOLLOWER]: Advancing to term 30
I20260615 08:08:21.136396 13580 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.136523 13580 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 30 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:21.136711 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 30 candidate_status { last_received { term: 28 index: 14356 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:21.136795 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 30 candidate_status { last_received { term: 28 index: 14356 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:21.136857 13400 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 29 FOLLOWER]: Advancing to term 30
I20260615 08:08:21.137290 13400 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 30.
I20260615 08:08:21.137450 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1
I20260615 08:08:21.137542 13580 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 30 FOLLOWER]: Leader election won for term 30
I20260615 08:08:21.137616 13580 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 30 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:21.137666 13580 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14356, Committed index: 14356, Last appended: 28.14356, Last appended by leader: 14356, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.138108 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 29 to 30, leader changed from 666bbeda390e4798abb1630585e244a1 (127.4.42.193) to d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194). New cstate: current_term: 30 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:21.161185 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 30 LEADER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 29. Current term is 30. Ops: []
I20260615 08:08:21.161443 13497 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14357, Last known committed idx: 14356, Time since last communication: 0.000s
I20260615 08:08:21.161564 13497 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer d4d7c2ebbf334b19a7f964aab04f280f log is divergent from this leader: its last log entry 30.14357 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14356
I20260615 08:08:21.167369 13250 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 29 LEADER]: Stepping down as leader of term 29
I20260615 08:08:21.167448 13250 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:21.167502 13250 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14356, Committed index: 14356, Last appended: 29.14357, Last appended by leader: 14357, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.167585 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 29 FOLLOWER]: Advancing to term 30
I20260615 08:08:21.168390 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 30 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 29 index: 14357. Preceding OpId from leader: term: 30 index: 14357. (term mismatch)
I20260615 08:08:21.168449 13250 pending_rounds.cc:85] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1: Aborting all ops after (but not including) 14356
I20260615 08:08:21.168475 13250 pending_rounds.cc:107] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1: Aborting uncommitted NO_OP operation due to leader change: 29.14357
I20260615 08:08:21.168509 13250 raft_consensus.cc:2889] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 30 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260615 08:08:21.168725 13580 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14357, Last known committed idx: 14356, Time since last communication: 0.000s
I20260615 08:08:21.170859 13400 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 30 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 28 index: 14356. Preceding OpId from leader: term: 30 index: 14357. (index mismatch)
I20260615 08:08:21.171042 13580 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14357, Last known committed idx: 14356, Time since last communication: 0.000s
I20260615 08:08:21.254947 13468 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 30 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:21.255031 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 30 FOLLOWER]: Advancing to term 31
I20260615 08:08:21.255776 13468 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.255935 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 31 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 30. Current term is 31. Ops: []
I20260615 08:08:21.255990 13468 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 31 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:21.256165 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 31 candidate_status { last_received { term: 30 index: 14357 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:21.256186 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 31 candidate_status { last_received { term: 30 index: 14357 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:21.256201 13522 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 30.14357, Next index: 14358, Last known committed idx: 14357, Time since last communication: 0.000s
I20260615 08:08:21.256500 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:21.256608 13468 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260615 08:08:21.257544 13580 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 30 LEADER]: Stepping down as leader of term 30
I20260615 08:08:21.257606 13580 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 30 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:21.257681 13580 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14357, Committed index: 14357, Last appended: 30.14357, Last appended by leader: 14357, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.257781 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 30 FOLLOWER]: Advancing to term 31
I20260615 08:08:21.281951 13555 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 30 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:21.282078 13555 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 30 FOLLOWER]: Advancing to term 31
I20260615 08:08:21.282727 13555 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.282923 13555 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 31 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:21.283097 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 31 candidate_status { last_received { term: 30 index: 14357 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:21.283192 13250 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c in current term 31: Already voted for candidate 666bbeda390e4798abb1630585e244a1 in this term.
I20260615 08:08:21.283152 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 31 candidate_status { last_received { term: 30 index: 14357 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:21.283780 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 31.
I20260615 08:08:21.283993 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1
I20260615 08:08:21.284103 13555 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 31 FOLLOWER]: Leader election won for term 31
I20260615 08:08:21.284170 13555 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 31 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:21.284229 13555 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14357, Committed index: 14357, Last appended: 30.14357, Last appended by leader: 14357, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.284667 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 30 to 31, leader changed from d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194) to b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195). New cstate: current_term: 31 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:21.296005 13468 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:21.296063 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 31 FOLLOWER]: Advancing to term 32
I20260615 08:08:21.296546 13468 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.296685 13468 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 32 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:21.296852 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 32 candidate_status { last_received { term: 30 index: 14357 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:21.296898 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 32 candidate_status { last_received { term: 30 index: 14357 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:21.296940 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 31 FOLLOWER]: Advancing to term 32
I20260615 08:08:21.297446 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 32.
I20260615 08:08:21.297647 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters: b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:21.297770 13468 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 32 FOLLOWER]: Leader election won for term 32
I20260615 08:08:21.297837 13468 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 32 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:21.297883 13468 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14357, Committed index: 14357, Last appended: 30.14357, Last appended by leader: 14357, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.306406 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 31 to 32, leader changed from b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195) to 666bbeda390e4798abb1630585e244a1 (127.4.42.193). New cstate: current_term: 32 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:21.311875 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 32 LEADER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 31. Current term is 32. Ops: []
I20260615 08:08:21.312083 13555 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14358, Last known committed idx: 14357, Time since last communication: 0.000s
I20260615 08:08:21.312211 13555 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer 666bbeda390e4798abb1630585e244a1 log is divergent from this leader: its last log entry 32.14358 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14357
I20260615 08:08:21.320907 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 32 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 31. Current term is 32. Ops: []
I20260615 08:08:21.321077 13555 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14358, Last known committed idx: 14357, Time since last communication: 0.000s
I20260615 08:08:21.325474 13400 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 31 LEADER]: Stepping down as leader of term 31
I20260615 08:08:21.325534 13400 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 31 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:21.325604 13400 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14357, Committed index: 14357, Last appended: 31.14358, Last appended by leader: 14358, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.325702 13400 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 31 FOLLOWER]: Advancing to term 32
I20260615 08:08:21.326327 13400 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 32 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 31 index: 14358. Preceding OpId from leader: term: 32 index: 14358. (term mismatch)
I20260615 08:08:21.326385 13400 pending_rounds.cc:85] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c: Aborting all ops after (but not including) 14357
I20260615 08:08:21.326408 13400 pending_rounds.cc:107] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c: Aborting uncommitted NO_OP operation due to leader change: 31.14358
I20260615 08:08:21.326440 13400 raft_consensus.cc:2889] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 32 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260615 08:08:21.326694 13468 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14358, Last known committed idx: 14357, Time since last communication: 0.000s
I20260615 08:08:21.330612 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 32 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 30 index: 14357. Preceding OpId from leader: term: 32 index: 14358. (index mismatch)
I20260615 08:08:21.330833 13468 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14358, Last known committed idx: 14357, Time since last communication: 0.000s
I20260615 08:08:21.357944 13563 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 32 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:21.358006 13563 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 32 FOLLOWER]: Advancing to term 33
I20260615 08:08:21.358631 13563 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.358781 13563 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 33 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:21.358922 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 33 candidate_status { last_received { term: 32 index: 14358 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:21.358922 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 33 candidate_status { last_received { term: 32 index: 14358 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:21.359143 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:21.359243 13563 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
I20260615 08:08:21.359627 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 33 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 32. Current term is 33. Ops: []
I20260615 08:08:21.359841 13588 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 32.14358, Next index: 14359, Last known committed idx: 14358, Time since last communication: 0.000s
I20260615 08:08:21.384122 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 33 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 32. Current term is 33. Ops: []
I20260615 08:08:21.384384 13497 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 32.14358, Next index: 14359, Last known committed idx: 14358, Time since last communication: 0.000s
I20260615 08:08:21.385598 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 32 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:21.385670 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 32 FOLLOWER]: Advancing to term 33
I20260615 08:08:21.386242 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.386381 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 33 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 32. Current term is 33. Ops: []
I20260615 08:08:21.386420 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 33 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:21.386560 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 33 candidate_status { last_received { term: 32 index: 14358 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:21.386583 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 33 candidate_status { last_received { term: 32 index: 14358 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:21.386735 13400 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f in current term 33: Already voted for candidate b97b73a5f2ad444eb230680e3c3fcb6c in this term.
I20260615 08:08:21.386729 13588 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 32.14358, Next index: 14359, Last known committed idx: 14358, Time since last communication: 0.000s
I20260615 08:08:21.386919 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:21.387007 13522 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
I20260615 08:08:21.396612 13563 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:21.396667 13563 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 33 FOLLOWER]: Advancing to term 34
I20260615 08:08:21.397243 13563 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.397389 13563 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 34 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:21.397548 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 34 candidate_status { last_received { term: 32 index: 14358 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:21.397548 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 34 candidate_status { last_received { term: 32 index: 14358 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:21.397644 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 33 FOLLOWER]: Advancing to term 34
I20260615 08:08:21.398145 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 34.
I20260615 08:08:21.398320 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1
I20260615 08:08:21.398427 13563 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 34 FOLLOWER]: Leader election won for term 34
I20260615 08:08:21.398587 13563 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 34 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:21.398667 13563 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14358, Committed index: 14358, Last appended: 32.14358, Last appended by leader: 14358, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.399101 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 32 to 34, leader changed from 666bbeda390e4798abb1630585e244a1 (127.4.42.193) to b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195). New cstate: current_term: 34 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:21.400856 13468 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 32 LEADER]: Stepping down as leader of term 32
I20260615 08:08:21.400914 13468 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 32 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:21.400979 13468 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14358, Committed index: 14358, Last appended: 32.14358, Last appended by leader: 14358, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.401070 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 32 FOLLOWER]: Advancing to term 33
I20260615 08:08:21.424484 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 34 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 32 index: 14358. Preceding OpId from leader: term: 34 index: 14359. (index mismatch)
I20260615 08:08:21.424693 13563 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14359, Last known committed idx: 14358, Time since last communication: 0.000s
I20260615 08:08:21.425421 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 33 FOLLOWER]: Advancing to term 34
I20260615 08:08:21.426095 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 34 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 32 index: 14358. Preceding OpId from leader: term: 34 index: 14359. (index mismatch)
I20260615 08:08:21.426283 13589 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14359, Last known committed idx: 14358, Time since last communication: 0.000s
I20260615 08:08:21.426386 13497 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 34 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:21.426437 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 34 FOLLOWER]: Advancing to term 35
I20260615 08:08:21.426959 13497 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 35 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.427062 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 35 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 34. Current term is 35. Ops: [34.14359-34.14359]
I20260615 08:08:21.427117 13497 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 35 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:21.427217 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 35 candidate_status { last_received { term: 32 index: 14358 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:21.427248 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 35 candidate_status { last_received { term: 32 index: 14358 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:21.427299 13589 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 32.14358, Next index: 14359, Last known committed idx: 14358, Time since last communication: 0.000s
I20260615 08:08:21.427414 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 35 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:21.427505 13497 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 35 FOLLOWER]: Leader election lost for term 35. Reason: could not achieve majority
I20260615 08:08:21.450462 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 35 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 34. Current term is 35. Ops: [34.14359-34.14359]
I20260615 08:08:21.450698 13555 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 32.14358, Next index: 14359, Last known committed idx: 14358, Time since last communication: 0.000s
I20260615 08:08:21.453779 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 35 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 34. Current term is 35. Ops: [34.14359-34.14359]
I20260615 08:08:21.454015 13589 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 32.14358, Next index: 14359, Last known committed idx: 14358, Time since last communication: 0.000s
I20260615 08:08:21.461091 13468 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 35 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:21.461162 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 35 FOLLOWER]: Advancing to term 36
I20260615 08:08:21.461796 13468 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 36 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.461961 13468 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 36 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:21.462137 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 36 candidate_status { last_received { term: 32 index: 14358 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:21.462148 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 36 candidate_status { last_received { term: 32 index: 14358 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:21.462424 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 36 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:21.462553 13468 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 36 FOLLOWER]: Leader election lost for term 36. Reason: could not achieve majority
I20260615 08:08:21.490829 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 36 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 34. Current term is 36. Ops: [34.14359-34.14359]
I20260615 08:08:21.491122 13555 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 32.14358, Next index: 14359, Last known committed idx: 14358, Time since last communication: 0.000s
I20260615 08:08:21.491801 13563 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 34 LEADER]: Stepping down as leader of term 34
I20260615 08:08:21.491837 13563 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 34 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:21.491916 13563 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14359, Committed index: 14359, Last appended: 34.14359, Last appended by leader: 14359, Current term: 34, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.491999 13563 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 34 FOLLOWER]: Advancing to term 35
I20260615 08:08:21.501020 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 34 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:21.501082 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 34 FOLLOWER]: Advancing to term 35
I20260615 08:08:21.501639 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 35 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.501784 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 35 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:21.501951 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 35 candidate_status { last_received { term: 34 index: 14359 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:21.502044 13250 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 36 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 35. Current term is 36.
I20260615 08:08:21.502012 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 35 candidate_status { last_received { term: 34 index: 14359 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:21.502236 13289 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 35 election: Vote denied by peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 36 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 35. Current term is 36.
I20260615 08:08:21.502279 13289 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 35 election: Cancelling election due to peer responding with higher term
I20260615 08:08:21.502389 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 35 FOLLOWER]: Advancing to term 36
I20260615 08:08:21.502820 13400 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 35.
I20260615 08:08:21.503091 13522 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 36 FOLLOWER]: Leader election lost for term 35. Reason: Vote denied by peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 36 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 35. Current term is 36.
I20260615 08:08:21.505000 13468 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 36 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:21.505060 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 36 FOLLOWER]: Advancing to term 37
I20260615 08:08:21.505522 13468 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 37 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.505652 13468 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 37 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:21.505813 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 37 candidate_status { last_received { term: 32 index: 14358 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:21.505838 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 37 candidate_status { last_received { term: 32 index: 14358 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:21.505906 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 36 FOLLOWER]: Advancing to term 37
I20260615 08:08:21.505918 13400 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 35 FOLLOWER]: Advancing to term 37
I20260615 08:08:21.506481 13400 raft_consensus.cc:2410] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 37 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for term 37 because replica has last-logged OpId of term: 34 index: 14359, which is greater than that of the candidate, which has last-logged OpId of term: 32 index: 14358.
I20260615 08:08:21.506480 13325 raft_consensus.cc:2410] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 37 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for term 37 because replica has last-logged OpId of term: 34 index: 14359, which is greater than that of the candidate, which has last-logged OpId of term: 32 index: 14358.
I20260615 08:08:21.506775 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 37 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:21.506875 13468 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 37 FOLLOWER]: Leader election lost for term 37. Reason: could not achieve majority
I20260615 08:08:21.537590 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 37 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:21.537681 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 37 FOLLOWER]: Advancing to term 38
I20260615 08:08:21.538259 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 38 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.538404 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 38 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:21.538642 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 38 candidate_status { last_received { term: 34 index: 14359 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:21.538712 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 38 candidate_status { last_received { term: 34 index: 14359 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:21.538751 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 37 FOLLOWER]: Advancing to term 38
I20260615 08:08:21.538761 13400 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 37 FOLLOWER]: Advancing to term 38
I20260615 08:08:21.539253 13400 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 38 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 38.
I20260615 08:08:21.539305 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 38 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 38.
I20260615 08:08:21.539484 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 38 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f; no voters:
I20260615 08:08:21.539572 13522 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 38 FOLLOWER]: Leader election won for term 38
I20260615 08:08:21.539633 13522 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 38 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:21.539708 13522 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14359, Committed index: 14359, Last appended: 34.14359, Last appended by leader: 14359, Current term: 38, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.540203 13146 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 34 to 38, leader changed from b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195) to d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194). New cstate: current_term: 38 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:21.563642 13400 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 38 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 34 index: 14359. Preceding OpId from leader: term: 38 index: 14360. (index mismatch)
I20260615 08:08:21.563921 13522 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14360, Last known committed idx: 14359, Time since last communication: 0.000s
I20260615 08:08:21.568719 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 38 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 32 index: 14358. Preceding OpId from leader: term: 38 index: 14360. (index mismatch)
I20260615 08:08:21.568944 13580 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14360, Last known committed idx: 14358, Time since last communication: 0.000s
W20260615 08:08:21.650259 13459 lock_manager.cc:494] Txn 3 has not acquired the partition lock after 1000ms
I20260615 08:08:21.682148 13497 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 38 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:21.682286 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 38 FOLLOWER]: Advancing to term 39
I20260615 08:08:21.683081 13497 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 39 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.683246 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 39 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 38. Current term is 39. Ops: []
I20260615 08:08:21.683264 13497 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 39 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:21.683408 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 39 candidate_status { last_received { term: 38 index: 14361 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:21.683439 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 39 candidate_status { last_received { term: 38 index: 14361 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:21.683482 13584 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 38.14361, Next index: 14362, Last known committed idx: 14361, Time since last communication: 0.000s
I20260615 08:08:21.683673 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 39 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:21.683794 13497 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 39 FOLLOWER]: Leader election lost for term 39. Reason: could not achieve majority
I20260615 08:08:21.687695 13584 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 38 LEADER]: Stepping down as leader of term 38
I20260615 08:08:21.687742 13584 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 38 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:21.687810 13584 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14361, Committed index: 14361, Last appended: 38.14361, Last appended by leader: 14361, Current term: 38, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.687918 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 38 FOLLOWER]: Advancing to term 39
I20260615 08:08:21.707836 13563 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 38 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:21.707911 13563 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 38 FOLLOWER]: Advancing to term 39
I20260615 08:08:21.708448 13563 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 39 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.708606 13563 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 39 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:21.708745 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 39 candidate_status { last_received { term: 38 index: 14361 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:21.708788 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 39 candidate_status { last_received { term: 38 index: 14361 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:21.708815 13250 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 39 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c in current term 39: Already voted for candidate 666bbeda390e4798abb1630585e244a1 in this term.
I20260615 08:08:21.709403 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 39 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 39.
I20260615 08:08:21.709606 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 39 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1
I20260615 08:08:21.709710 13563 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 39 FOLLOWER]: Leader election won for term 39
I20260615 08:08:21.709808 13563 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 39 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:21.709864 13563 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14361, Committed index: 14361, Last appended: 38.14361, Last appended by leader: 14361, Current term: 39, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.710314 13146 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 38 to 39, leader changed from d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194) to b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195). New cstate: current_term: 39 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:21.723155 13497 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 39 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:21.723223 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 39 FOLLOWER]: Advancing to term 40
I20260615 08:08:21.723701 13497 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 40 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.723861 13497 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 40 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:21.724009 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 40 candidate_status { last_received { term: 38 index: 14361 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:21.724006 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 40 candidate_status { last_received { term: 38 index: 14361 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:21.724160 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 39 FOLLOWER]: Advancing to term 40
I20260615 08:08:21.724650 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 40 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 40.
I20260615 08:08:21.724858 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 40 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters: b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:21.724962 13497 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 40 FOLLOWER]: Leader election won for term 40
I20260615 08:08:21.725018 13497 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 40 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:21.725065 13497 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14361, Committed index: 14361, Last appended: 38.14361, Last appended by leader: 14361, Current term: 40, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.738658 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 40 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 39. Current term is 40. Ops: []
I20260615 08:08:21.739042 13563 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14362, Last known committed idx: 14361, Time since last communication: 0.000s
I20260615 08:08:21.739089 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 39 to 40, leader changed from b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195) to 666bbeda390e4798abb1630585e244a1 (127.4.42.193). New cstate: current_term: 40 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:21.739236 13563 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 39 LEADER]: Stepping down as leader of term 39
I20260615 08:08:21.739270 13563 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 39 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:21.739321 13563 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14361, Committed index: 14361, Last appended: 39.14362, Last appended by leader: 14362, Current term: 39, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.739391 13563 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 39 FOLLOWER]: Advancing to term 40
I20260615 08:08:21.757011 13400 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 40 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 39 index: 14362. Preceding OpId from leader: term: 40 index: 14362. (term mismatch)
I20260615 08:08:21.757107 13400 pending_rounds.cc:85] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c: Aborting all ops after (but not including) 14361
I20260615 08:08:21.757128 13400 pending_rounds.cc:107] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c: Aborting uncommitted NO_OP operation due to leader change: 39.14362
I20260615 08:08:21.757150 13400 raft_consensus.cc:2889] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 40 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260615 08:08:21.757360 13584 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 40 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:21.757432 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 40 FOLLOWER]: Advancing to term 41
I20260615 08:08:21.757404 13497 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14362, Last known committed idx: 14361, Time since last communication: 0.000s
I20260615 08:08:21.758389 13584 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 41 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.758548 13584 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 41 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:21.758664 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 41 candidate_status { last_received { term: 38 index: 14361 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:21.758672 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 41 candidate_status { last_received { term: 38 index: 14361 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:21.758908 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 41 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:21.759011 13584 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 41 FOLLOWER]: Leader election lost for term 41. Reason: could not achieve majority
I20260615 08:08:21.759832 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 41 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 40. Current term is 41. Ops: []
I20260615 08:08:21.760030 13497 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14362, Last known committed idx: 14361, Time since last communication: 0.000s
I20260615 08:08:21.787675 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 41 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 40. Current term is 41. Ops: [40.14362-40.14362]
I20260615 08:08:21.787930 13588 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 38.14361, Next index: 14362, Last known committed idx: 14361, Time since last communication: 0.000s
I20260615 08:08:21.788673 13563 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 40 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:21.788730 13563 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 40 FOLLOWER]: Advancing to term 41
I20260615 08:08:21.789331 13563 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 41 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.789482 13563 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 41 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:21.789615 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 41 candidate_status { last_received { term: 40 index: 14362 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:21.789674 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 41 candidate_status { last_received { term: 40 index: 14362 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:21.789749 13325 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 41 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c in current term 41: Already voted for candidate d4d7c2ebbf334b19a7f964aab04f280f in this term.
I20260615 08:08:21.789920 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 41 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:21.790021 13563 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 41 FOLLOWER]: Leader election lost for term 41. Reason: could not achieve majority
I20260615 08:08:21.791249 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 41 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 40. Current term is 41. Ops: []
I20260615 08:08:21.791481 13588 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 40.14362, Next index: 14363, Last known committed idx: 14362, Time since last communication: 0.000s
I20260615 08:08:21.803427 13584 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 41 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:21.803493 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 41 FOLLOWER]: Advancing to term 42
I20260615 08:08:21.804073 13584 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 42 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.804219 13584 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 42 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:21.804415 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 42 candidate_status { last_received { term: 38 index: 14361 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:21.804430 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 42 candidate_status { last_received { term: 38 index: 14361 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:21.804594 13400 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 41 FOLLOWER]: Advancing to term 42
I20260615 08:08:21.805275 13400 raft_consensus.cc:2410] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 42 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for term 42 because replica has last-logged OpId of term: 40 index: 14362, which is greater than that of the candidate, which has last-logged OpId of term: 38 index: 14361.
I20260615 08:08:21.805485 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 42 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:21.805576 13584 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 42 FOLLOWER]: Leader election lost for term 42. Reason: could not achieve majority
I20260615 08:08:21.812711 13497 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 40 LEADER]: Stepping down as leader of term 40
I20260615 08:08:21.812760 13497 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 40 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:21.812829 13497 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14362, Committed index: 14362, Last appended: 40.14362, Last appended by leader: 14362, Current term: 40, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.812915 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 40 FOLLOWER]: Advancing to term 41
I20260615 08:08:21.832499 13563 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 42 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:21.832568 13563 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 42 FOLLOWER]: Advancing to term 43
I20260615 08:08:21.833112 13563 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 43 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.833279 13563 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 43 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:21.833518 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 43 candidate_status { last_received { term: 40 index: 14362 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:21.833624 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 41 FOLLOWER]: Advancing to term 43
I20260615 08:08:21.833514 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 43 candidate_status { last_received { term: 40 index: 14362 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:21.833668 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 42 FOLLOWER]: Advancing to term 43
I20260615 08:08:21.834110 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 43 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 43.
I20260615 08:08:21.834205 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 43 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 43.
I20260615 08:08:21.834300 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 43 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters:
I20260615 08:08:21.834407 13563 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 43 FOLLOWER]: Leader election won for term 43
I20260615 08:08:21.834486 13563 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 43 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:21.834551 13563 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14362, Committed index: 14362, Last appended: 40.14362, Last appended by leader: 14362, Current term: 43, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.835062 13146 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 40 to 43, leader changed from 666bbeda390e4798abb1630585e244a1 (127.4.42.193) to b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195). New cstate: current_term: 43 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:21.858258 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 43 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 38 index: 14361. Preceding OpId from leader: term: 43 index: 14363. (index mismatch)
I20260615 08:08:21.858560 13563 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14363, Last known committed idx: 14361, Time since last communication: 0.000s
I20260615 08:08:21.869395 13497 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 43 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:21.869481 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 43 FOLLOWER]: Advancing to term 44
I20260615 08:08:21.870051 13497 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 44 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.870203 13497 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 44 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:21.870316 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 44 candidate_status { last_received { term: 40 index: 14362 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:21.870389 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 44 candidate_status { last_received { term: 40 index: 14362 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:21.870568 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 44 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:21.870672 13497 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 44 FOLLOWER]: Leader election lost for term 44. Reason: could not achieve majority
I20260615 08:08:21.871351 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 44 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 43. Current term is 44. Ops: []
I20260615 08:08:21.871563 13555 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14363, Last known committed idx: 14362, Time since last communication: 0.000s
I20260615 08:08:21.880920 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 44 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 43. Current term is 44. Ops: [43.14363-43.14363]
I20260615 08:08:21.881153 13589 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 40.14362, Next index: 14363, Last known committed idx: 14362, Time since last communication: 0.000s
I20260615 08:08:21.904661 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 44 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 43. Current term is 44. Ops: [43.14363-43.14363]
I20260615 08:08:21.904964 13555 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 40.14362, Next index: 14363, Last known committed idx: 14362, Time since last communication: 0.000s
I20260615 08:08:21.907012 13497 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 44 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:21.907063 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 44 FOLLOWER]: Advancing to term 45
I20260615 08:08:21.907684 13497 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 45 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.907848 13497 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 45 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:21.908030 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 45 candidate_status { last_received { term: 40 index: 14362 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:21.908035 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 45 candidate_status { last_received { term: 40 index: 14362 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:21.908332 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 45 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:21.908422 13497 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 45 FOLLOWER]: Leader election lost for term 45. Reason: could not achieve majority
I20260615 08:08:21.937134 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 45 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 43. Current term is 45. Ops: [43.14363-43.14363]
I20260615 08:08:21.937462 13563 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 40.14362, Next index: 14363, Last known committed idx: 14362, Time since last communication: 0.000s
I20260615 08:08:21.942958 13589 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 43 LEADER]: Stepping down as leader of term 43
I20260615 08:08:21.943019 13589 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 43 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:21.943076 13589 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14363, Committed index: 14363, Last appended: 43.14363, Last appended by leader: 14363, Current term: 43, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.943161 13589 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 43 FOLLOWER]: Advancing to term 44
I20260615 08:08:21.955878 13497 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 45 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:21.955976 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 45 FOLLOWER]: Advancing to term 46
I20260615 08:08:21.956583 13497 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 46 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.956774 13497 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 46 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:21.956984 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 46 candidate_status { last_received { term: 40 index: 14362 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:21.956984 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 46 candidate_status { last_received { term: 40 index: 14362 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:21.957101 13400 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 44 FOLLOWER]: Advancing to term 46
I20260615 08:08:21.957628 13400 raft_consensus.cc:2410] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 46 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for term 46 because replica has last-logged OpId of term: 43 index: 14363, which is greater than that of the candidate, which has last-logged OpId of term: 40 index: 14362.
I20260615 08:08:21.957842 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 46 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:21.957960 13497 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 46 FOLLOWER]: Leader election lost for term 46. Reason: could not achieve majority
I20260615 08:08:21.963704 13584 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 43 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:21.963785 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 43 FOLLOWER]: Advancing to term 44
I20260615 08:08:21.964483 13584 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 44 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.964617 13584 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 44 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:21.964799 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 44 candidate_status { last_received { term: 43 index: 14363 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:21.964929 13400 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 46 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 44. Current term is 46.
I20260615 08:08:21.964936 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 44 candidate_status { last_received { term: 43 index: 14363 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:21.965060 13250 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 46 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 44. Current term is 46.
I20260615 08:08:21.965123 13289 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 44 election: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 46 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 44. Current term is 46.
I20260615 08:08:21.965166 13289 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 44 election: Cancelling election due to peer responding with higher term
I20260615 08:08:21.965224 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 44 FOLLOWER]: Advancing to term 46
I20260615 08:08:21.965250 13289 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 44 election: Vote denied by peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 46 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 44. Current term is 46.
I20260615 08:08:21.965723 13584 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 46 FOLLOWER]: Leader election lost for term 44. Reason: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 46 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 44. Current term is 46.
I20260615 08:08:21.972352 13555 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 46 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:21.972400 13555 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 46 FOLLOWER]: Advancing to term 47
I20260615 08:08:21.972874 13555 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 47 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.973021 13555 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 47 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:21.973170 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 47 candidate_status { last_received { term: 43 index: 14363 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:21.973241 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 46 FOLLOWER]: Advancing to term 47
I20260615 08:08:21.973264 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 47 candidate_status { last_received { term: 43 index: 14363 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:21.973368 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 46 FOLLOWER]: Advancing to term 47
I20260615 08:08:21.973759 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 47 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 47.
I20260615 08:08:21.973917 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 47 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 47.
I20260615 08:08:21.973975 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 47 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters:
I20260615 08:08:21.974064 13555 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 47 FOLLOWER]: Leader election won for term 47
I20260615 08:08:21.974133 13555 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 47 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:21.974190 13555 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14363, Committed index: 14363, Last appended: 43.14363, Last appended by leader: 14363, Current term: 47, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:21.974673 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 43 to 47. New cstate: current_term: 47 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
W20260615 08:08:21.981935 13589 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 44 current term: 47 is higher.
I20260615 08:08:21.998813 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 47 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 43 index: 14363. Preceding OpId from leader: term: 47 index: 14364. (index mismatch)
I20260615 08:08:21.999024 13563 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14364, Last known committed idx: 14363, Time since last communication: 0.000s
I20260615 08:08:22.008214 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 47 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 40 index: 14362. Preceding OpId from leader: term: 47 index: 14364. (index mismatch)
I20260615 08:08:22.008433 13563 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14364, Last known committed idx: 14362, Time since last communication: 0.000s
W20260615 08:08:22.013096 13589 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 45 current term: 47 is higher.
I20260615 08:08:22.039443 13497 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 47 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:22.039512 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 47 FOLLOWER]: Advancing to term 48
I20260615 08:08:22.040131 13497 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 48 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.040289 13497 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 48 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:22.040429 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 48 candidate_status { last_received { term: 47 index: 14364 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:22.040483 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 48 candidate_status { last_received { term: 47 index: 14364 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:22.040711 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 48 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:22.040809 13497 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 48 FOLLOWER]: Leader election lost for term 48. Reason: could not achieve majority
I20260615 08:08:22.041297 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 48 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 47. Current term is 48. Ops: []
I20260615 08:08:22.041498 13563 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 47.14364, Next index: 14365, Last known committed idx: 14364, Time since last communication: 0.000s
I20260615 08:08:22.067602 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 48 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 47. Current term is 48. Ops: []
I20260615 08:08:22.067874 13555 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 47.14364, Next index: 14365, Last known committed idx: 14364, Time since last communication: 0.000s
I20260615 08:08:22.071522 13497 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 48 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:22.071602 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 48 FOLLOWER]: Advancing to term 49
I20260615 08:08:22.072233 13497 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 49 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.072388 13497 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 49 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:22.072556 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 49 candidate_status { last_received { term: 47 index: 14364 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:22.072556 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 49 candidate_status { last_received { term: 47 index: 14364 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:22.072844 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 49 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:22.072949 13497 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 49 FOLLOWER]: Leader election lost for term 49. Reason: could not achieve majority
I20260615 08:08:22.075654 13584 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 47 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:22.075709 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 47 FOLLOWER]: Advancing to term 48
I20260615 08:08:22.076356 13584 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 48 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.076457 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 48 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 47. Current term is 48. Ops: []
I20260615 08:08:22.076493 13584 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 48 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:22.076614 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 48 candidate_status { last_received { term: 47 index: 14364 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:22.076648 13563 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 47.14364, Next index: 14365, Last known committed idx: 14364, Time since last communication: 0.000s
I20260615 08:08:22.076628 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 48 candidate_status { last_received { term: 47 index: 14364 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:22.076774 13250 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 49 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 48. Current term is 49.
I20260615 08:08:22.076906 13289 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 48 election: Vote denied by peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 49 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 48. Current term is 49.
I20260615 08:08:22.076943 13289 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 48 election: Cancelling election due to peer responding with higher term
I20260615 08:08:22.077003 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 48 FOLLOWER]: Advancing to term 49
I20260615 08:08:22.077436 13584 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 49 FOLLOWER]: Leader election lost for term 48. Reason: Vote denied by peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 49 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 48. Current term is 49.
I20260615 08:08:22.099491 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 49 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 47. Current term is 49. Ops: []
I20260615 08:08:22.099785 13555 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 47.14364, Next index: 14365, Last known committed idx: 14364, Time since last communication: 0.000s
I20260615 08:08:22.107388 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 49 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 47. Current term is 49. Ops: []
I20260615 08:08:22.107649 13589 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 47.14364, Next index: 14365, Last known committed idx: 14364, Time since last communication: 0.000s
I20260615 08:08:22.114717 13584 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 49 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:22.114791 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 49 FOLLOWER]: Advancing to term 50
I20260615 08:08:22.115429 13584 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 50 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.115573 13584 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 50 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:22.115787 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 50 candidate_status { last_received { term: 47 index: 14364 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:22.115796 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 50 candidate_status { last_received { term: 47 index: 14364 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:22.115895 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 49 FOLLOWER]: Advancing to term 50
I20260615 08:08:22.116379 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 50 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 50.
I20260615 08:08:22.116551 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 50 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters: b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:22.116639 13584 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 50 FOLLOWER]: Leader election won for term 50
I20260615 08:08:22.116726 13584 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 50 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:22.116796 13584 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14364, Committed index: 14364, Last appended: 47.14364, Last appended by leader: 14364, Current term: 50, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.117215 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 47 to 50, leader changed from b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195) to d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194). New cstate: current_term: 50 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:22.117709 13563 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 47 LEADER]: Stepping down as leader of term 47
I20260615 08:08:22.117745 13563 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 47 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:22.117812 13563 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14364, Committed index: 14364, Last appended: 47.14364, Last appended by leader: 14364, Current term: 47, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.117899 13563 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 47 FOLLOWER]: Advancing to term 48
I20260615 08:08:22.151193 13555 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 48 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:22.151319 13555 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 48 FOLLOWER]: Advancing to term 49
I20260615 08:08:22.151997 13555 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 49 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.152148 13400 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 49 FOLLOWER]: Advancing to term 50
I20260615 08:08:22.152220 13555 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 49 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:22.152443 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 49 candidate_status { last_received { term: 47 index: 14364 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:22.152482 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 49 candidate_status { last_received { term: 47 index: 14364 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:22.152572 13250 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 50 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 49. Current term is 50.
I20260615 08:08:22.152729 13364 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 49 election: Vote denied by peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 50 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 49. Current term is 50.
I20260615 08:08:22.152772 13364 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 49 election: Cancelling election due to peer responding with higher term
I20260615 08:08:22.152925 13400 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 50 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 47 index: 14364. Preceding OpId from leader: term: 50 index: 14365. (index mismatch)
I20260615 08:08:22.153003 13555 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 50 FOLLOWER]: Leader election lost for term 49. Reason: Vote denied by peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 50 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 49. Current term is 50.
I20260615 08:08:22.153185 13584 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14365, Last known committed idx: 14364, Time since last communication: 0.000s
I20260615 08:08:22.153499 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 50 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 47 index: 14364. Preceding OpId from leader: term: 50 index: 14365. (index mismatch)
I20260615 08:08:22.153678 13522 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14365, Last known committed idx: 14364, Time since last communication: 0.000s
I20260615 08:08:22.238404 13563 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 50 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:22.238540 13563 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 50 FOLLOWER]: Advancing to term 51
I20260615 08:08:22.239176 13563 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 51 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.239378 13563 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 51 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:22.239584 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 51 candidate_status { last_received { term: 50 index: 14365 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:22.239609 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 51 candidate_status { last_received { term: 50 index: 14365 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:22.239837 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 51 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:22.239938 13563 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 51 FOLLOWER]: Leader election lost for term 51. Reason: could not achieve majority
I20260615 08:08:22.243760 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 51 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 50. Current term is 51. Ops: []
I20260615 08:08:22.243978 13584 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 50.14365, Next index: 14366, Last known committed idx: 14365, Time since last communication: 0.000s
I20260615 08:08:22.251171 13522 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 50 LEADER]: Stepping down as leader of term 50
I20260615 08:08:22.251217 13522 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 50 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:22.251283 13522 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14365, Committed index: 14365, Last appended: 50.14365, Last appended by leader: 14365, Current term: 50, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.251374 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 50 FOLLOWER]: Advancing to term 51
I20260615 08:08:22.263160 13497 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 50 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:22.263232 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 50 FOLLOWER]: Advancing to term 51
I20260615 08:08:22.263809 13497 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 51 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.263988 13497 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 51 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:22.264159 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 51 candidate_status { last_received { term: 50 index: 14365 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:22.264201 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 51 candidate_status { last_received { term: 50 index: 14365 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:22.264267 13400 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 51 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 in current term 51: Already voted for candidate b97b73a5f2ad444eb230680e3c3fcb6c in this term.
I20260615 08:08:22.264824 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 51 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 51.
I20260615 08:08:22.265050 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 51 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters: b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:22.265149 13497 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 51 FOLLOWER]: Leader election won for term 51
I20260615 08:08:22.265208 13497 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 51 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:22.265275 13497 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14365, Committed index: 14365, Last appended: 50.14365, Last appended by leader: 14365, Current term: 51, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.265786 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 50 to 51, leader changed from d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194) to 666bbeda390e4798abb1630585e244a1 (127.4.42.193). New cstate: current_term: 51 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:22.284504 13563 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 51 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:22.284582 13563 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 51 FOLLOWER]: Advancing to term 52
I20260615 08:08:22.285135 13563 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 52 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.285302 13563 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 52 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:22.285472 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 52 candidate_status { last_received { term: 50 index: 14365 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:22.285571 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 52 candidate_status { last_received { term: 50 index: 14365 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:22.285678 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 51 FOLLOWER]: Advancing to term 52
I20260615 08:08:22.286204 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 52 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 52.
I20260615 08:08:22.286424 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 52 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f; no voters:
I20260615 08:08:22.286540 13563 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 52 FOLLOWER]: Leader election won for term 52
I20260615 08:08:22.286600 13563 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 52 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:22.286650 13563 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14365, Committed index: 14365, Last appended: 50.14365, Last appended by leader: 14365, Current term: 52, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.287679 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 52 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 51. Current term is 52. Ops: []
I20260615 08:08:22.287855 13497 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14366, Last known committed idx: 14365, Time since last communication: 0.000s
I20260615 08:08:22.296343 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 52 LEADER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 51. Current term is 52. Ops: []
I20260615 08:08:22.296571 13588 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14366, Last known committed idx: 14365, Time since last communication: 0.000s
I20260615 08:08:22.296682 13588 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer b97b73a5f2ad444eb230680e3c3fcb6c log is divergent from this leader: its last log entry 52.14366 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14365
I20260615 08:08:22.299036 13497 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 51 LEADER]: Stepping down as leader of term 51
I20260615 08:08:22.299080 13497 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 51 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:22.299178 13497 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14365, Committed index: 14365, Last appended: 51.14366, Last appended by leader: 14366, Current term: 51, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.299263 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 51 FOLLOWER]: Advancing to term 52
I20260615 08:08:22.310750 13146 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 51 to 52, leader changed from 666bbeda390e4798abb1630585e244a1 (127.4.42.193) to b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195). New cstate: current_term: 52 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:22.313269 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 52 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 51 index: 14366. Preceding OpId from leader: term: 52 index: 14366. (term mismatch)
I20260615 08:08:22.313314 13250 pending_rounds.cc:85] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1: Aborting all ops after (but not including) 14365
I20260615 08:08:22.313328 13250 pending_rounds.cc:107] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1: Aborting uncommitted NO_OP operation due to leader change: 51.14366
I20260615 08:08:22.313341 13250 raft_consensus.cc:2889] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 52 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260615 08:08:22.313587 13563 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14366, Last known committed idx: 14365, Time since last communication: 0.000s
I20260615 08:08:22.318427 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 52 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 50 index: 14365. Preceding OpId from leader: term: 52 index: 14366. (index mismatch)
I20260615 08:08:22.318658 13563 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14366, Last known committed idx: 14365, Time since last communication: 0.000s
I20260615 08:08:22.377496 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 52 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:22.377585 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 52 FOLLOWER]: Advancing to term 53
I20260615 08:08:22.378211 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 53 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.378372 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 53 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:22.378688 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 53 candidate_status { last_received { term: 52 index: 14366 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:22.378670 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 53 candidate_status { last_received { term: 52 index: 14366 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:22.378938 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 53 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:22.379045 13522 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 53 FOLLOWER]: Leader election lost for term 53. Reason: could not achieve majority
I20260615 08:08:22.381891 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 53 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 52. Current term is 53. Ops: []
I20260615 08:08:22.382107 13563 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 52.14366, Next index: 14367, Last known committed idx: 14366, Time since last communication: 0.000s
I20260615 08:08:22.385421 13563 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 52 LEADER]: Stepping down as leader of term 52
I20260615 08:08:22.385497 13563 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 52 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:22.385563 13563 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14366, Committed index: 14366, Last appended: 52.14366, Last appended by leader: 14366, Current term: 52, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.385663 13563 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 52 FOLLOWER]: Advancing to term 53
I20260615 08:08:22.399080 13497 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 52 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:22.399180 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 52 FOLLOWER]: Advancing to term 53
I20260615 08:08:22.399745 13497 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 53 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.399909 13497 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 53 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:22.400090 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 53 candidate_status { last_received { term: 52 index: 14366 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:22.400107 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 53 candidate_status { last_received { term: 52 index: 14366 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:22.400249 13325 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 53 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 in current term 53: Already voted for candidate d4d7c2ebbf334b19a7f964aab04f280f in this term.
I20260615 08:08:22.400723 13400 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 53 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 53.
I20260615 08:08:22.400944 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 53 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters: d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:22.401039 13497 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 53 FOLLOWER]: Leader election won for term 53
I20260615 08:08:22.401095 13497 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 53 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:22.401158 13497 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14366, Committed index: 14366, Last appended: 52.14366, Last appended by leader: 14366, Current term: 53, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.401674 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 52 to 53, leader changed from b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195) to 666bbeda390e4798abb1630585e244a1 (127.4.42.193). New cstate: current_term: 53 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:22.411432 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 53 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:22.411509 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 53 FOLLOWER]: Advancing to term 54
I20260615 08:08:22.412066 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 54 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.412222 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 54 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:22.412392 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 54 candidate_status { last_received { term: 52 index: 14366 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:22.412400 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 54 candidate_status { last_received { term: 52 index: 14366 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:22.412586 13400 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 53 FOLLOWER]: Advancing to term 54
I20260615 08:08:22.413085 13400 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 54 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 54.
I20260615 08:08:22.413232 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 54 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1
I20260615 08:08:22.413357 13522 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 54 FOLLOWER]: Leader election won for term 54
I20260615 08:08:22.413414 13522 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 54 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:22.413489 13522 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14366, Committed index: 14366, Last appended: 52.14366, Last appended by leader: 14366, Current term: 54, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.425114 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 54 LEADER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 53. Current term is 54. Ops: []
I20260615 08:08:22.425351 13497 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14367, Last known committed idx: 14366, Time since last communication: 0.000s
I20260615 08:08:22.425453 13497 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer d4d7c2ebbf334b19a7f964aab04f280f log is divergent from this leader: its last log entry 54.14367 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14366
I20260615 08:08:22.427457 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 53 to 54, leader changed from 666bbeda390e4798abb1630585e244a1 (127.4.42.193) to d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194). New cstate: current_term: 54 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:22.431576 13588 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 53 LEADER]: Stepping down as leader of term 53
I20260615 08:08:22.431625 13588 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 53 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:22.431697 13588 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14366, Committed index: 14366, Last appended: 53.14367, Last appended by leader: 14367, Current term: 53, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.431783 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 53 FOLLOWER]: Advancing to term 54
I20260615 08:08:22.438189 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 54 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 53 index: 14367. Preceding OpId from leader: term: 54 index: 14367. (term mismatch)
I20260615 08:08:22.438251 13250 pending_rounds.cc:85] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1: Aborting all ops after (but not including) 14366
I20260615 08:08:22.438272 13250 pending_rounds.cc:107] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1: Aborting uncommitted NO_OP operation due to leader change: 53.14367
I20260615 08:08:22.438314 13250 raft_consensus.cc:2889] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 54 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260615 08:08:22.438580 13522 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14367, Last known committed idx: 14366, Time since last communication: 0.000s
I20260615 08:08:22.445329 13400 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 54 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 52 index: 14366. Preceding OpId from leader: term: 54 index: 14367. (index mismatch)
I20260615 08:08:22.445587 13522 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14367, Last known committed idx: 14366, Time since last communication: 0.000s
I20260615 08:08:22.530901 13563 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 54 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:22.530990 13563 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 54 FOLLOWER]: Advancing to term 55
I20260615 08:08:22.531734 13563 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 55 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.531859 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 55 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 54. Current term is 55. Ops: []
I20260615 08:08:22.531970 13563 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 55 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:22.532024 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 55 candidate_status { last_received { term: 54 index: 14367 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:22.532049 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 55 candidate_status { last_received { term: 54 index: 14367 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:22.532083 13584 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 54.14367, Next index: 14368, Last known committed idx: 14367, Time since last communication: 0.000s
I20260615 08:08:22.532302 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 55 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:22.532418 13563 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 55 FOLLOWER]: Leader election lost for term 55. Reason: could not achieve majority
I20260615 08:08:22.536346 13580 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 54 LEADER]: Stepping down as leader of term 54
I20260615 08:08:22.536396 13580 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 54 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:22.536443 13580 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14367, Committed index: 14367, Last appended: 54.14367, Last appended by leader: 14367, Current term: 54, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.536512 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 54 FOLLOWER]: Advancing to term 55
I20260615 08:08:22.550944 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 54 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:22.551000 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 54 FOLLOWER]: Advancing to term 55
I20260615 08:08:22.551579 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 55 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.551734 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 55 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:22.551918 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 55 candidate_status { last_received { term: 54 index: 14367 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:22.551918 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 55 candidate_status { last_received { term: 54 index: 14367 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:22.552013 13400 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 55 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 in current term 55: Already voted for candidate b97b73a5f2ad444eb230680e3c3fcb6c in this term.
I20260615 08:08:22.552559 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 55 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 55.
I20260615 08:08:22.552734 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 55 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters: b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:22.552840 13588 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 55 FOLLOWER]: Leader election won for term 55
I20260615 08:08:22.552914 13588 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 55 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:22.552968 13588 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14367, Committed index: 14367, Last appended: 54.14367, Last appended by leader: 14367, Current term: 55, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.553445 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 54 to 55, leader changed from d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194) to 666bbeda390e4798abb1630585e244a1 (127.4.42.193). New cstate: current_term: 55 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:22.569813 13563 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 55 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:22.569862 13563 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 55 FOLLOWER]: Advancing to term 56
I20260615 08:08:22.570322 13563 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 56 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.570457 13563 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 56 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:22.570596 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 56 candidate_status { last_received { term: 54 index: 14367 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:22.570642 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 56 candidate_status { last_received { term: 54 index: 14367 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:22.570734 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 55 FOLLOWER]: Advancing to term 56
I20260615 08:08:22.571214 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 56 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 56.
I20260615 08:08:22.571410 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 56 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1
I20260615 08:08:22.571502 13563 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 56 FOLLOWER]: Leader election won for term 56
I20260615 08:08:22.571594 13563 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 56 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:22.571643 13563 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14367, Committed index: 14367, Last appended: 54.14367, Last appended by leader: 14367, Current term: 56, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.579213 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 56 LEADER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 55. Current term is 56. Ops: []
I20260615 08:08:22.579448 13588 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14368, Last known committed idx: 14367, Time since last communication: 0.000s
I20260615 08:08:22.579631 13588 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer b97b73a5f2ad444eb230680e3c3fcb6c log is divergent from this leader: its last log entry 56.14368 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14367
I20260615 08:08:22.585690 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 56 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 55. Current term is 56. Ops: []
I20260615 08:08:22.585944 13588 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14368, Last known committed idx: 14367, Time since last communication: 0.000s
I20260615 08:08:22.591229 13146 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 55 to 56, leader changed from 666bbeda390e4798abb1630585e244a1 (127.4.42.193) to b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195). New cstate: current_term: 56 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:22.598788 13250 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 55 LEADER]: Stepping down as leader of term 55
I20260615 08:08:22.598831 13250 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 55 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:22.598896 13250 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14367, Committed index: 14367, Last appended: 55.14368, Last appended by leader: 14368, Current term: 55, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.598973 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 55 FOLLOWER]: Advancing to term 56
I20260615 08:08:22.599464 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 56 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 55 index: 14368. Preceding OpId from leader: term: 56 index: 14368. (term mismatch)
I20260615 08:08:22.599498 13250 pending_rounds.cc:85] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1: Aborting all ops after (but not including) 14367
I20260615 08:08:22.599510 13250 pending_rounds.cc:107] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1: Aborting uncommitted NO_OP operation due to leader change: 55.14368
I20260615 08:08:22.599524 13250 raft_consensus.cc:2889] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 56 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260615 08:08:22.599740 13563 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14368, Last known committed idx: 14367, Time since last communication: 0.000s
I20260615 08:08:22.601145 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 56 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 54 index: 14367. Preceding OpId from leader: term: 56 index: 14368. (index mismatch)
I20260615 08:08:22.601368 13563 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14368, Last known committed idx: 14367, Time since last communication: 0.000s
I20260615 08:08:22.632251 13580 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 56 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:22.632352 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 56 FOLLOWER]: Advancing to term 57
I20260615 08:08:22.632885 13580 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 57 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.633036 13580 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 57 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:22.633245 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 57 candidate_status { last_received { term: 56 index: 14368 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:22.633293 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 57 candidate_status { last_received { term: 56 index: 14368 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:22.633502 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 57 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:22.633602 13580 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 57 FOLLOWER]: Leader election lost for term 57. Reason: could not achieve majority
I20260615 08:08:22.634423 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 57 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 56. Current term is 57. Ops: []
I20260615 08:08:22.634639 13589 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 56.14368, Next index: 14369, Last known committed idx: 14368, Time since last communication: 0.000s
I20260615 08:08:22.653281 13497 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 56 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:22.653396 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 56 FOLLOWER]: Advancing to term 57
I20260615 08:08:22.654055 13497 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 57 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.654276 13497 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 57 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:22.654333 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 57 candidate_status { last_received { term: 56 index: 14368 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:22.654356 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 57 candidate_status { last_received { term: 56 index: 14368 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:22.654520 13325 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 57 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 in current term 57: Already voted for candidate d4d7c2ebbf334b19a7f964aab04f280f in this term.
I20260615 08:08:22.654688 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 57 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:22.654800 13497 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 57 FOLLOWER]: Leader election lost for term 57. Reason: could not achieve majority
I20260615 08:08:22.656920 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 57 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 56. Current term is 57. Ops: []
I20260615 08:08:22.657148 13563 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 56.14368, Next index: 14369, Last known committed idx: 14368, Time since last communication: 0.000s
W20260615 08:08:22.657393 13462 lock_manager.cc:494] Txn 4 has not acquired the partition lock after 1000ms
I20260615 08:08:22.662101 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 57 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 56. Current term is 57. Ops: []
I20260615 08:08:22.662292 13589 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 56.14368, Next index: 14369, Last known committed idx: 14368, Time since last communication: 0.000s
I20260615 08:08:22.674466 13580 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 57 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:22.674574 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 57 FOLLOWER]: Advancing to term 58
I20260615 08:08:22.675149 13580 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 58 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.675290 13580 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 58 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:22.675475 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 58 candidate_status { last_received { term: 56 index: 14368 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:22.675521 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 58 candidate_status { last_received { term: 56 index: 14368 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:22.675581 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 57 FOLLOWER]: Advancing to term 58
I20260615 08:08:22.676115 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 58 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 58.
I20260615 08:08:22.676316 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 58 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters: b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:22.676422 13580 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 58 FOLLOWER]: Leader election won for term 58
I20260615 08:08:22.676504 13580 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 58 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:22.676558 13580 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14368, Committed index: 14368, Last appended: 56.14368, Last appended by leader: 14368, Current term: 58, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.677012 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 56 to 58, leader changed from b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195) to d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194). New cstate: current_term: 58 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:22.685781 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 58 LEADER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 56. Current term is 58. Ops: []
I20260615 08:08:22.686009 13555 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 56.14368, Next index: 14369, Last known committed idx: 14368, Time since last communication: 0.000s
I20260615 08:08:22.686110 13555 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer d4d7c2ebbf334b19a7f964aab04f280f log is divergent from this leader: its last log entry 58.14369 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14368
I20260615 08:08:22.690399 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 58 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 56. Current term is 58. Ops: []
I20260615 08:08:22.690659 13563 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 56.14368, Next index: 14369, Last known committed idx: 14368, Time since last communication: 0.000s
I20260615 08:08:22.695034 13589 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 56 LEADER]: Stepping down as leader of term 56
I20260615 08:08:22.695075 13589 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 56 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:22.695139 13589 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14368, Committed index: 14368, Last appended: 56.14368, Last appended by leader: 14368, Current term: 56, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.695216 13589 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 56 FOLLOWER]: Advancing to term 57
I20260615 08:08:22.702582 13400 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 57 FOLLOWER]: Advancing to term 58
I20260615 08:08:22.703112 13400 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 58 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 56 index: 14368. Preceding OpId from leader: term: 58 index: 14369. (index mismatch)
I20260615 08:08:22.703354 13580 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14369, Last known committed idx: 14368, Time since last communication: 0.000s
I20260615 08:08:22.705412 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 58 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 56 index: 14368. Preceding OpId from leader: term: 58 index: 14369. (index mismatch)
I20260615 08:08:22.705618 13580 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14369, Last known committed idx: 14368, Time since last communication: 0.000s
I20260615 08:08:22.734440 13555 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 58 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:22.734556 13555 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 58 FOLLOWER]: Advancing to term 59
I20260615 08:08:22.735179 13555 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 59 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.735383 13555 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 59 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:22.735504 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 59 candidate_status { last_received { term: 58 index: 14369 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:22.735519 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 59 candidate_status { last_received { term: 58 index: 14369 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:22.735805 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 59 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:22.735911 13555 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 59 FOLLOWER]: Leader election lost for term 59. Reason: could not achieve majority
I20260615 08:08:22.737919 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 59 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 58. Current term is 59. Ops: []
I20260615 08:08:22.738130 13584 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 58.14369, Next index: 14370, Last known committed idx: 14369, Time since last communication: 0.000s
I20260615 08:08:22.774499 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 59 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 58. Current term is 59. Ops: []
I20260615 08:08:22.774803 13522 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 58.14369, Next index: 14370, Last known committed idx: 14369, Time since last communication: 0.000s
I20260615 08:08:22.776245 13555 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 59 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:22.776291 13555 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 59 FOLLOWER]: Advancing to term 60
I20260615 08:08:22.776880 13555 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 60 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.777029 13555 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 60 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:22.777171 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 60 candidate_status { last_received { term: 58 index: 14369 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:22.777172 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 60 candidate_status { last_received { term: 58 index: 14369 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:22.777426 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 60 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:22.777565 13555 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 60 FOLLOWER]: Leader election lost for term 60. Reason: could not achieve majority
I20260615 08:08:22.792972 13468 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 58 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:22.793084 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 58 FOLLOWER]: Advancing to term 59
I20260615 08:08:22.793638 13584 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 58 LEADER]: Stepping down as leader of term 58
I20260615 08:08:22.793691 13584 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 58 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:22.793747 13468 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 59 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.793792 13584 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14369, Committed index: 14369, Last appended: 58.14369, Last appended by leader: 14369, Current term: 58, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.793888 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 58 FOLLOWER]: Advancing to term 59
I20260615 08:08:22.793933 13468 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 59 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:22.794090 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 59 candidate_status { last_received { term: 58 index: 14369 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:22.794090 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 59 candidate_status { last_received { term: 58 index: 14369 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:22.794188 13400 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 60 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 59. Current term is 60.
I20260615 08:08:22.794394 13213 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 59 election: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 60 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 59. Current term is 60.
I20260615 08:08:22.794427 13213 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 59 election: Cancelling election due to peer responding with higher term
I20260615 08:08:22.794513 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 59 FOLLOWER]: Advancing to term 60
I20260615 08:08:22.794983 13468 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 60 FOLLOWER]: Leader election lost for term 59. Reason: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 60 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 59. Current term is 60.
I20260615 08:08:22.795222 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 59 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 59.
I20260615 08:08:22.822705 13589 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 60 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:22.822808 13589 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 60 FOLLOWER]: Advancing to term 61
I20260615 08:08:22.823572 13589 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 61 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.823768 13589 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 61 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:22.823993 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 61 candidate_status { last_received { term: 58 index: 14369 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:22.824011 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 61 candidate_status { last_received { term: 58 index: 14369 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:22.824122 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 60 FOLLOWER]: Advancing to term 61
I20260615 08:08:22.824144 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 59 FOLLOWER]: Advancing to term 61
I20260615 08:08:22.824649 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 61 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 61.
I20260615 08:08:22.824699 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 61 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 61.
I20260615 08:08:22.824906 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 61 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f; no voters:
I20260615 08:08:22.825008 13589 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 61 FOLLOWER]: Leader election won for term 61
I20260615 08:08:22.825074 13589 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 61 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:22.825130 13589 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14369, Committed index: 14369, Last appended: 58.14369, Last appended by leader: 14369, Current term: 61, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.825590 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 58 to 61, leader changed from d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194) to b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195). New cstate: current_term: 61 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:22.849129 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 61 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 58 index: 14369. Preceding OpId from leader: term: 61 index: 14370. (index mismatch)
I20260615 08:08:22.849438 13589 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14370, Last known committed idx: 14369, Time since last communication: 0.000s
I20260615 08:08:22.855742 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 61 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 58 index: 14369. Preceding OpId from leader: term: 61 index: 14370. (index mismatch)
I20260615 08:08:22.855929 13589 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14370, Last known committed idx: 14369, Time since last communication: 0.000s
I20260615 08:08:22.880720 13584 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 61 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:22.880820 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 61 FOLLOWER]: Advancing to term 62
I20260615 08:08:22.881537 13584 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 62 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.881716 13584 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 62 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:22.881974 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 62 candidate_status { last_received { term: 61 index: 14370 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:22.882027 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 62 candidate_status { last_received { term: 61 index: 14370 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:22.882265 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 62 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:22.882365 13584 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 62 FOLLOWER]: Leader election lost for term 62. Reason: could not achieve majority
I20260615 08:08:22.885289 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 62 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 61. Current term is 62. Ops: []
I20260615 08:08:22.885625 13589 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 61.14370, Next index: 14371, Last known committed idx: 14370, Time since last communication: 0.000s
I20260615 08:08:22.886722 13468 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 61 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:22.886770 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 61 FOLLOWER]: Advancing to term 62
I20260615 08:08:22.887410 13468 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 62 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.887558 13468 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 62 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:22.887678 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 62 candidate_status { last_received { term: 61 index: 14370 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:22.887687 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 62 candidate_status { last_received { term: 61 index: 14370 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:22.887765 13325 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 62 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 in current term 62: Already voted for candidate d4d7c2ebbf334b19a7f964aab04f280f in this term.
I20260615 08:08:22.887931 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 62 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:22.888052 13468 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 62 FOLLOWER]: Leader election lost for term 62. Reason: could not achieve majority
I20260615 08:08:22.891896 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 62 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 61. Current term is 62. Ops: []
I20260615 08:08:22.892149 13555 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 61.14370, Next index: 14371, Last known committed idx: 14370, Time since last communication: 0.000s
I20260615 08:08:22.914880 13584 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 62 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:22.914961 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 62 FOLLOWER]: Advancing to term 63
I20260615 08:08:22.915724 13584 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 63 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.915846 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 63 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 61. Current term is 63. Ops: []
I20260615 08:08:22.915884 13584 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 63 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:22.916039 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 63 candidate_status { last_received { term: 61 index: 14370 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:22.916023 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 63 candidate_status { last_received { term: 61 index: 14370 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:22.916157 13563 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 61.14370, Next index: 14371, Last known committed idx: 14370, Time since last communication: 0.000s
I20260615 08:08:22.916288 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 62 FOLLOWER]: Advancing to term 63
I20260615 08:08:22.916806 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 63 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 63.
I20260615 08:08:22.917026 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 63 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters: b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:22.917127 13584 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 63 FOLLOWER]: Leader election won for term 63
I20260615 08:08:22.917200 13584 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 63 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:22.917251 13584 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14370, Committed index: 14370, Last appended: 61.14370, Last appended by leader: 14370, Current term: 63, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.917676 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 61 to 63, leader changed from b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195) to d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194). New cstate: current_term: 63 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:22.927681 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 63 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 61. Current term is 63. Ops: []
I20260615 08:08:22.927886 13555 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 61.14370, Next index: 14371, Last known committed idx: 14370, Time since last communication: 0.000s
I20260615 08:08:22.938539 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 63 LEADER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 61. Current term is 63. Ops: []
I20260615 08:08:22.938800 13563 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 61.14370, Next index: 14371, Last known committed idx: 14370, Time since last communication: 0.000s
I20260615 08:08:22.938874 13563 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer d4d7c2ebbf334b19a7f964aab04f280f log is divergent from this leader: its last log entry 63.14371 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14370
I20260615 08:08:22.940832 13589 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 61 LEADER]: Stepping down as leader of term 61
I20260615 08:08:22.940900 13589 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 61 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:22.940976 13589 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14370, Committed index: 14370, Last appended: 61.14370, Last appended by leader: 14370, Current term: 61, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:22.941073 13589 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 61 FOLLOWER]: Advancing to term 62
I20260615 08:08:22.945142 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 63 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 61 index: 14370. Preceding OpId from leader: term: 63 index: 14371. (index mismatch)
I20260615 08:08:22.945405 13584 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14371, Last known committed idx: 14370, Time since last communication: 0.000s
I20260615 08:08:22.948733 13400 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 62 FOLLOWER]: Advancing to term 63
I20260615 08:08:22.949334 13400 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 63 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 61 index: 14370. Preceding OpId from leader: term: 63 index: 14371. (index mismatch)
I20260615 08:08:22.949545 13584 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14371, Last known committed idx: 14370, Time since last communication: 0.000s
I20260615 08:08:23.002691 13468 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 63 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:23.002771 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 63 FOLLOWER]: Advancing to term 64
I20260615 08:08:23.003351 13468 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 64 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.003510 13468 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 64 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:23.003655 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 64 candidate_status { last_received { term: 63 index: 14371 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:23.003698 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 64 candidate_status { last_received { term: 63 index: 14371 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:23.003937 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 64 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:23.004035 13468 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 64 FOLLOWER]: Leader election lost for term 64. Reason: could not achieve majority
I20260615 08:08:23.007161 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 64 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 63. Current term is 64. Ops: []
I20260615 08:08:23.007390 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 63.14371, Next index: 14372, Last known committed idx: 14371, Time since last communication: 0.000s
I20260615 08:08:23.024696 13580 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 63 LEADER]: Stepping down as leader of term 63
I20260615 08:08:23.024750 13580 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 63 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:23.024828 13580 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14371, Committed index: 14371, Last appended: 63.14371, Last appended by leader: 14371, Current term: 63, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.024926 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 63 FOLLOWER]: Advancing to term 64
I20260615 08:08:23.026741 13563 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 63 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:23.026790 13563 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 63 FOLLOWER]: Advancing to term 64
I20260615 08:08:23.027225 13563 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 64 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.027364 13563 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 64 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:23.027493 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 64 candidate_status { last_received { term: 63 index: 14371 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:23.027556 13250 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 64 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c in current term 64: Already voted for candidate 666bbeda390e4798abb1630585e244a1 in this term.
I20260615 08:08:23.027550 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 64 candidate_status { last_received { term: 63 index: 14371 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:23.028115 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 64 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 64.
I20260615 08:08:23.028326 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 64 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1
I20260615 08:08:23.028431 13563 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 64 FOLLOWER]: Leader election won for term 64
I20260615 08:08:23.028493 13563 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 64 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:23.028527 13563 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14371, Committed index: 14371, Last appended: 63.14371, Last appended by leader: 14371, Current term: 64, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.028956 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 63 to 64, leader changed from d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194) to b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195). New cstate: current_term: 64 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:23.041949 13468 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 64 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:23.042011 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 64 FOLLOWER]: Advancing to term 65
I20260615 08:08:23.042598 13468 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 65 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.042727 13468 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 65 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:23.042860 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 65 candidate_status { last_received { term: 63 index: 14371 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:23.042870 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 65 candidate_status { last_received { term: 63 index: 14371 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:23.042997 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 64 FOLLOWER]: Advancing to term 65
I20260615 08:08:23.043552 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 65 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 65.
I20260615 08:08:23.043746 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 65 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters: b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:23.043846 13468 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 65 FOLLOWER]: Leader election won for term 65
I20260615 08:08:23.043924 13468 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 65 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:23.043972 13468 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14371, Committed index: 14371, Last appended: 63.14371, Last appended by leader: 14371, Current term: 65, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.044730 13146 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 64 to 65, leader changed from b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195) to 666bbeda390e4798abb1630585e244a1 (127.4.42.193). New cstate: current_term: 65 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
W20260615 08:08:23.058178 13589 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 63 current term: 64 is higher.
I20260615 08:08:23.058553 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 65 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 64. Current term is 65. Ops: []
I20260615 08:08:23.058823 13563 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14372, Last known committed idx: 14371, Time since last communication: 0.000s
I20260615 08:08:23.062141 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 65 LEADER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 64. Current term is 65. Ops: []
I20260615 08:08:23.062361 13555 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14372, Last known committed idx: 14371, Time since last communication: 0.000s
I20260615 08:08:23.062453 13555 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer 666bbeda390e4798abb1630585e244a1 log is divergent from this leader: its last log entry 65.14372 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14371
I20260615 08:08:23.073693 13400 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 64 LEADER]: Stepping down as leader of term 64
I20260615 08:08:23.073748 13400 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 64 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:23.073910 13400 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14371, Committed index: 14371, Last appended: 64.14372, Last appended by leader: 14372, Current term: 64, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.073993 13400 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 64 FOLLOWER]: Advancing to term 65
I20260615 08:08:23.074630 13400 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 65 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 64 index: 14372. Preceding OpId from leader: term: 65 index: 14372. (term mismatch)
I20260615 08:08:23.074666 13400 pending_rounds.cc:85] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c: Aborting all ops after (but not including) 14371
I20260615 08:08:23.074679 13400 pending_rounds.cc:107] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c: Aborting uncommitted NO_OP operation due to leader change: 64.14372
I20260615 08:08:23.074692 13400 raft_consensus.cc:2889] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 65 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260615 08:08:23.074898 13468 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14372, Last known committed idx: 14371, Time since last communication: 0.000s
I20260615 08:08:23.076965 13580 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 65 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:23.077014 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 65 FOLLOWER]: Advancing to term 66
I20260615 08:08:23.077502 13580 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 66 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.077641 13580 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 66 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:23.077785 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 66 candidate_status { last_received { term: 63 index: 14371 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:23.077793 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 66 candidate_status { last_received { term: 63 index: 14371 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:23.078047 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 66 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:23.078150 13580 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 66 FOLLOWER]: Leader election lost for term 66. Reason: could not achieve majority
I20260615 08:08:23.079705 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 66 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 65. Current term is 66. Ops: []
I20260615 08:08:23.079910 13468 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14372, Last known committed idx: 14371, Time since last communication: 0.000s
I20260615 08:08:23.105465 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 66 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 65. Current term is 66. Ops: [65.14372-65.14372]
I20260615 08:08:23.105705 13497 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 63.14371, Next index: 14372, Last known committed idx: 14371, Time since last communication: 0.000s
I20260615 08:08:23.108608 13580 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 66 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:23.108662 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 66 FOLLOWER]: Advancing to term 67
I20260615 08:08:23.109182 13580 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 67 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.109313 13580 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 67 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:23.109472 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 67 candidate_status { last_received { term: 63 index: 14371 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:23.109525 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 67 candidate_status { last_received { term: 63 index: 14371 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:23.109793 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 67 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:23.109877 13580 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 67 FOLLOWER]: Leader election lost for term 67. Reason: could not achieve majority
I20260615 08:08:23.112996 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 67 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 65. Current term is 67. Ops: [65.14372-65.14372]
I20260615 08:08:23.113199 13468 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 63.14371, Next index: 14372, Last known committed idx: 14371, Time since last communication: 0.000s
I20260615 08:08:23.132858 13555 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 65 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:23.132918 13555 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 65 FOLLOWER]: Advancing to term 66
I20260615 08:08:23.133473 13555 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 66 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.133616 13555 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 66 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:23.133745 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 66 candidate_status { last_received { term: 65 index: 14372 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:23.133759 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 66 candidate_status { last_received { term: 65 index: 14372 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:23.133805 13325 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 67 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 66. Current term is 67.
I20260615 08:08:23.133962 13366 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 66 election: Vote denied by peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 67 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 66. Current term is 67.
I20260615 08:08:23.134002 13366 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 66 election: Cancelling election due to peer responding with higher term
I20260615 08:08:23.134076 13555 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 66 FOLLOWER]: Advancing to term 67
I20260615 08:08:23.134573 13555 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 67 FOLLOWER]: Leader election lost for term 66. Reason: Vote denied by peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 67 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 66. Current term is 67.
I20260615 08:08:23.135151 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 67 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 65. Current term is 67. Ops: []
I20260615 08:08:23.135375 13588 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 65.14372, Next index: 14373, Last known committed idx: 14372, Time since last communication: 0.000s
I20260615 08:08:23.136219 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 67 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 65. Current term is 67. Ops: [65.14372-65.14372]
I20260615 08:08:23.136451 13497 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 63.14371, Next index: 14372, Last known committed idx: 14371, Time since last communication: 0.000s
I20260615 08:08:23.137050 13468 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 65 LEADER]: Stepping down as leader of term 65
I20260615 08:08:23.137089 13468 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 65 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:23.137149 13468 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14372, Committed index: 14372, Last appended: 65.14372, Last appended by leader: 14372, Current term: 65, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.137221 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 65 FOLLOWER]: Advancing to term 66
I20260615 08:08:23.163324 13580 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 67 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:23.163380 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 67 FOLLOWER]: Advancing to term 68
I20260615 08:08:23.163815 13580 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 68 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.163926 13580 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 68 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:23.164081 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 68 candidate_status { last_received { term: 63 index: 14371 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:23.164125 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 68 candidate_status { last_received { term: 63 index: 14371 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:23.164192 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 66 FOLLOWER]: Advancing to term 68
I20260615 08:08:23.164206 13400 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 67 FOLLOWER]: Advancing to term 68
I20260615 08:08:23.164693 13400 raft_consensus.cc:2410] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 68 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for term 68 because replica has last-logged OpId of term: 65 index: 14372, which is greater than that of the candidate, which has last-logged OpId of term: 63 index: 14371.
I20260615 08:08:23.164698 13250 raft_consensus.cc:2410] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 68 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for term 68 because replica has last-logged OpId of term: 65 index: 14372, which is greater than that of the candidate, which has last-logged OpId of term: 63 index: 14371.
I20260615 08:08:23.164925 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 68 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:23.165005 13580 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 68 FOLLOWER]: Leader election lost for term 68. Reason: could not achieve majority
I20260615 08:08:23.168063 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 68 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:23.168141 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 68 FOLLOWER]: Advancing to term 69
I20260615 08:08:23.168682 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 69 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.168810 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 69 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:23.168944 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 69 candidate_status { last_received { term: 65 index: 14372 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:23.169003 13400 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 68 FOLLOWER]: Advancing to term 69
I20260615 08:08:23.168968 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 69 candidate_status { last_received { term: 65 index: 14372 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:23.169071 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 68 FOLLOWER]: Advancing to term 69
I20260615 08:08:23.169498 13400 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 69 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 69.
I20260615 08:08:23.169600 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 69 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 69.
I20260615 08:08:23.169674 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 69 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters:
I20260615 08:08:23.169776 13588 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 69 FOLLOWER]: Leader election won for term 69
I20260615 08:08:23.169842 13588 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 69 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:23.169886 13588 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14372, Committed index: 14372, Last appended: 65.14372, Last appended by leader: 14372, Current term: 69, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.170290 13146 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 65 to 69. New cstate: current_term: 69 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
W20260615 08:08:23.178864 13468 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 67 current term: 69 is higher.
W20260615 08:08:23.184100 13468 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 67 current term: 69 is higher.
I20260615 08:08:23.199538 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 69 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 63 index: 14371. Preceding OpId from leader: term: 69 index: 14373. (index mismatch)
I20260615 08:08:23.199772 13588 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14373, Last known committed idx: 14371, Time since last communication: 0.000s
I20260615 08:08:23.200382 13400 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 69 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 65 index: 14372. Preceding OpId from leader: term: 69 index: 14373. (index mismatch)
I20260615 08:08:23.200537 13588 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14373, Last known committed idx: 14372, Time since last communication: 0.000s
W20260615 08:08:23.203233 13468 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 67 current term: 69 is higher.
I20260615 08:08:23.257949 13555 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 69 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:23.258045 13555 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 69 FOLLOWER]: Advancing to term 70
I20260615 08:08:23.258690 13555 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 70 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.258841 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 70 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 69. Current term is 70. Ops: []
I20260615 08:08:23.258935 13555 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 70 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:23.259016 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 70 candidate_status { last_received { term: 69 index: 14373 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:23.259056 13497 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 69.14373, Next index: 14374, Last known committed idx: 14373, Time since last communication: 0.000s
I20260615 08:08:23.259066 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 70 candidate_status { last_received { term: 69 index: 14373 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:23.259374 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 70 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:23.259476 13555 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 70 FOLLOWER]: Leader election lost for term 70. Reason: could not achieve majority
I20260615 08:08:23.280725 13580 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 69 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:23.280797 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 69 FOLLOWER]: Advancing to term 70
I20260615 08:08:23.280943 13468 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 69 LEADER]: Stepping down as leader of term 69
I20260615 08:08:23.281009 13468 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 69 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:23.281070 13468 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14373, Committed index: 14373, Last appended: 69.14373, Last appended by leader: 14373, Current term: 69, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.281172 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 69 FOLLOWER]: Advancing to term 70
I20260615 08:08:23.281562 13580 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 70 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.281724 13580 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 70 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:23.281864 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 70 candidate_status { last_received { term: 69 index: 14373 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:23.281910 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 70 candidate_status { last_received { term: 69 index: 14373 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:23.282006 13401 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 70 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f in current term 70: Already voted for candidate b97b73a5f2ad444eb230680e3c3fcb6c in this term.
I20260615 08:08:23.282585 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 70 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 70.
I20260615 08:08:23.282788 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 70 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters: b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:23.282891 13580 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 70 FOLLOWER]: Leader election won for term 70
I20260615 08:08:23.282969 13580 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 70 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:23.283110 13580 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14373, Committed index: 14373, Last appended: 69.14373, Last appended by leader: 14373, Current term: 70, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.283546 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 69 to 70, leader changed from 666bbeda390e4798abb1630585e244a1 (127.4.42.193) to d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194). New cstate: current_term: 70 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:23.303803 13555 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 70 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:23.303869 13555 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 70 FOLLOWER]: Advancing to term 71
I20260615 08:08:23.304417 13555 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 71 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.304579 13555 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 71 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:23.304742 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 71 candidate_status { last_received { term: 69 index: 14373 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:23.304790 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 71 candidate_status { last_received { term: 69 index: 14373 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:23.304816 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 70 FOLLOWER]: Advancing to term 71
I20260615 08:08:23.305380 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 71 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 71.
I20260615 08:08:23.305567 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 71 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters: d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:23.305697 13555 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 71 FOLLOWER]: Leader election won for term 71
I20260615 08:08:23.305761 13555 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 71 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:23.305817 13555 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14373, Committed index: 14373, Last appended: 69.14373, Last appended by leader: 14373, Current term: 71, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.306254 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 70 to 71, leader changed from d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194) to b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195). New cstate: current_term: 71 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:23.308022 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 71 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 70. Current term is 71. Ops: []
I20260615 08:08:23.308221 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14374, Last known committed idx: 14373, Time since last communication: 0.000s
I20260615 08:08:23.312465 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 71 LEADER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 70. Current term is 71. Ops: []
I20260615 08:08:23.312675 13584 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14374, Last known committed idx: 14373, Time since last communication: 0.000s
I20260615 08:08:23.312769 13584 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer b97b73a5f2ad444eb230680e3c3fcb6c log is divergent from this leader: its last log entry 71.14374 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14373
I20260615 08:08:23.332500 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 71 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 69 index: 14373. Preceding OpId from leader: term: 71 index: 14374. (index mismatch)
I20260615 08:08:23.332772 13555 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14374, Last known committed idx: 14373, Time since last communication: 0.000s
I20260615 08:08:23.336660 13325 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 70 LEADER]: Stepping down as leader of term 70
I20260615 08:08:23.336721 13325 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 70 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:23.336807 13325 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14373, Committed index: 14373, Last appended: 70.14374, Last appended by leader: 14374, Current term: 70, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.336908 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 70 FOLLOWER]: Advancing to term 71
I20260615 08:08:23.337438 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 71 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 70 index: 14374. Preceding OpId from leader: term: 71 index: 14374. (term mismatch)
I20260615 08:08:23.337499 13325 pending_rounds.cc:85] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f: Aborting all ops after (but not including) 14373
I20260615 08:08:23.337519 13325 pending_rounds.cc:107] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f: Aborting uncommitted NO_OP operation due to leader change: 70.14374
I20260615 08:08:23.337548 13325 raft_consensus.cc:2889] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 71 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260615 08:08:23.337757 13555 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14374, Last known committed idx: 14373, Time since last communication: 0.000s
I20260615 08:08:23.363898 13468 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 71 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:23.363962 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 71 FOLLOWER]: Advancing to term 72
I20260615 08:08:23.364544 13468 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 72 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.364693 13468 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 72 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:23.364847 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 72 candidate_status { last_received { term: 71 index: 14374 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:23.364848 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 72 candidate_status { last_received { term: 71 index: 14374 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:23.365125 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 72 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:23.365239 13468 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 72 FOLLOWER]: Leader election lost for term 72. Reason: could not achieve majority
I20260615 08:08:23.366463 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 72 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 71. Current term is 72. Ops: []
I20260615 08:08:23.366709 13555 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 71.14374, Next index: 14375, Last known committed idx: 14374, Time since last communication: 0.000s
I20260615 08:08:23.393438 13580 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 71 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:23.393494 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 71 FOLLOWER]: Advancing to term 72
I20260615 08:08:23.394019 13580 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 72 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.394148 13580 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 72 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:23.394318 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 72 candidate_status { last_received { term: 71 index: 14374 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:23.394335 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 72 candidate_status { last_received { term: 71 index: 14374 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:23.394443 13250 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 72 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f in current term 72: Already voted for candidate 666bbeda390e4798abb1630585e244a1 in this term.
I20260615 08:08:23.394593 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 72 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:23.394678 13580 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 72 FOLLOWER]: Leader election lost for term 72. Reason: could not achieve majority
I20260615 08:08:23.396574 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 72 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 71. Current term is 72. Ops: []
I20260615 08:08:23.396665 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 72 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 71. Current term is 72. Ops: []
I20260615 08:08:23.396823 13589 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 71.14374, Next index: 14375, Last known committed idx: 14374, Time since last communication: 0.000s
I20260615 08:08:23.396934 13563 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 71.14374, Next index: 14375, Last known committed idx: 14374, Time since last communication: 0.000s
I20260615 08:08:23.398629 13468 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 72 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:23.398681 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 72 FOLLOWER]: Advancing to term 73
I20260615 08:08:23.399184 13468 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 73 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.399343 13468 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 73 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:23.399467 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 73 candidate_status { last_received { term: 71 index: 14374 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:23.399473 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 73 candidate_status { last_received { term: 71 index: 14374 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:23.399569 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 72 FOLLOWER]: Advancing to term 73
I20260615 08:08:23.400066 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 73 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 73.
I20260615 08:08:23.400229 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 73 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters: b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:23.400344 13468 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 73 FOLLOWER]: Leader election won for term 73
I20260615 08:08:23.400413 13468 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 73 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:23.400477 13468 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14374, Committed index: 14374, Last appended: 71.14374, Last appended by leader: 14374, Current term: 73, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.400863 13146 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 71 to 73, leader changed from b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195) to 666bbeda390e4798abb1630585e244a1 (127.4.42.193). New cstate: current_term: 73 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:23.410969 13555 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 71 LEADER]: Stepping down as leader of term 71
I20260615 08:08:23.411018 13555 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 71 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:23.411093 13555 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14374, Committed index: 14374, Last appended: 71.14374, Last appended by leader: 14374, Current term: 71, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.411167 13555 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 71 FOLLOWER]: Advancing to term 72
I20260615 08:08:23.426280 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 73 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 71 index: 14374. Preceding OpId from leader: term: 73 index: 14375. (index mismatch)
I20260615 08:08:23.426512 13468 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14375, Last known committed idx: 14374, Time since last communication: 0.000s
I20260615 08:08:23.430104 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 72 FOLLOWER]: Advancing to term 73
I20260615 08:08:23.430761 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 73 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 71 index: 14374. Preceding OpId from leader: term: 73 index: 14375. (index mismatch)
I20260615 08:08:23.430998 13588 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14375, Last known committed idx: 14374, Time since last communication: 0.000s
I20260615 08:08:23.461614 13589 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 73 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:23.461712 13589 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 73 FOLLOWER]: Advancing to term 74
I20260615 08:08:23.462337 13589 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 74 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.462524 13589 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 74 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:23.462659 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 74 candidate_status { last_received { term: 73 index: 14375 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:23.462704 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 74 candidate_status { last_received { term: 73 index: 14375 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:23.462976 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 74 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:23.463074 13589 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 74 FOLLOWER]: Leader election lost for term 74. Reason: could not achieve majority
I20260615 08:08:23.466230 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 74 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 73. Current term is 74. Ops: []
I20260615 08:08:23.466444 13588 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 73.14375, Next index: 14376, Last known committed idx: 14375, Time since last communication: 0.000s
I20260615 08:08:23.493038 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 74 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 73. Current term is 74. Ops: []
I20260615 08:08:23.493269 13468 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 73.14375, Next index: 14376, Last known committed idx: 14375, Time since last communication: 0.000s
I20260615 08:08:23.496435 13555 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 74 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:23.496502 13555 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 74 FOLLOWER]: Advancing to term 75
I20260615 08:08:23.497102 13555 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 75 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.497234 13555 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 75 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:23.497381 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 75 candidate_status { last_received { term: 73 index: 14375 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:23.497393 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 75 candidate_status { last_received { term: 73 index: 14375 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:23.497638 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 75 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:23.497735 13555 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 75 FOLLOWER]: Leader election lost for term 75. Reason: could not achieve majority
I20260615 08:08:23.503785 13497 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 73 LEADER]: Stepping down as leader of term 73
I20260615 08:08:23.503866 13497 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 73 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:23.503957 13497 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14375, Committed index: 14375, Last appended: 73.14375, Last appended by leader: 14375, Current term: 73, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.504067 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 73 FOLLOWER]: Advancing to term 74
I20260615 08:08:23.515062 13580 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 73 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:23.515128 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 73 FOLLOWER]: Advancing to term 74
I20260615 08:08:23.515693 13580 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 74 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.515847 13580 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 74 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:23.516016 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 74 candidate_status { last_received { term: 73 index: 14375 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:23.516022 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 74 candidate_status { last_received { term: 73 index: 14375 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:23.516135 13401 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 75 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 74. Current term is 75.
I20260615 08:08:23.516355 13289 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 74 election: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 75 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 74. Current term is 75.
I20260615 08:08:23.516397 13289 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 74 election: Cancelling election due to peer responding with higher term
I20260615 08:08:23.516467 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 74 FOLLOWER]: Advancing to term 75
I20260615 08:08:23.516790 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 74 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 74.
I20260615 08:08:23.517037 13580 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 75 FOLLOWER]: Leader election lost for term 74. Reason: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 75 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 74. Current term is 75.
I20260615 08:08:23.559566 13497 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 74 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:23.559675 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 74 FOLLOWER]: Advancing to term 75
I20260615 08:08:23.560247 13497 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 75 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.560395 13580 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 75 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:23.560421 13497 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 75 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:23.560485 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 75 FOLLOWER]: Advancing to term 76
I20260615 08:08:23.560640 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 75 candidate_status { last_received { term: 73 index: 14375 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:23.560591 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 75 candidate_status { last_received { term: 73 index: 14375 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:23.560714 13401 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 75 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 in current term 75: Already voted for candidate b97b73a5f2ad444eb230680e3c3fcb6c in this term.
I20260615 08:08:23.561095 13580 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 76 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.561246 13325 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 76 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 75. Current term is 76.
I20260615 08:08:23.561255 13580 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 76 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:23.561410 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 76 candidate_status { last_received { term: 73 index: 14375 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:23.561424 13215 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 75 election: Vote denied by peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 76 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 75. Current term is 76.
I20260615 08:08:23.561456 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 76 candidate_status { last_received { term: 73 index: 14375 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:23.561492 13215 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 75 election: Cancelling election due to peer responding with higher term
I20260615 08:08:23.561578 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 75 FOLLOWER]: Advancing to term 76
I20260615 08:08:23.561492 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 75 FOLLOWER]: Advancing to term 76
I20260615 08:08:23.562229 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 76 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 76.
I20260615 08:08:23.562251 13401 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 76 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 76.
I20260615 08:08:23.562317 13497 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 76 FOLLOWER]: Leader election lost for term 75. Reason: Vote denied by peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 76 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 75. Current term is 76.
I20260615 08:08:23.562409 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 76 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters:
I20260615 08:08:23.562517 13580 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 76 FOLLOWER]: Leader election won for term 76
I20260615 08:08:23.562577 13580 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 76 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:23.562618 13580 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14375, Committed index: 14375, Last appended: 73.14375, Last appended by leader: 14375, Current term: 76, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.563031 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 73 to 76, leader changed from 666bbeda390e4798abb1630585e244a1 (127.4.42.193) to d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194). New cstate: current_term: 76 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:23.590386 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 76 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 73 index: 14375. Preceding OpId from leader: term: 76 index: 14376. (index mismatch)
I20260615 08:08:23.590687 13580 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14376, Last known committed idx: 14375, Time since last communication: 0.000s
I20260615 08:08:23.596899 13497 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 76 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:23.596963 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 76 FOLLOWER]: Advancing to term 77
I20260615 08:08:23.597608 13497 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 77 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.597764 13497 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 77 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:23.597918 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 77 candidate_status { last_received { term: 73 index: 14375 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:23.597918 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 77 candidate_status { last_received { term: 73 index: 14375 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:23.598186 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 77 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:23.598299 13497 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 77 FOLLOWER]: Leader election lost for term 77. Reason: could not achieve majority
I20260615 08:08:23.598418 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 77 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 76. Current term is 77. Ops: []
I20260615 08:08:23.598634 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14376, Last known committed idx: 14375, Time since last communication: 0.000s
I20260615 08:08:23.621848 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 77 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 76. Current term is 77. Ops: [76.14376-76.14376]
I20260615 08:08:23.622103 13584 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 73.14375, Next index: 14376, Last known committed idx: 14375, Time since last communication: 0.000s
I20260615 08:08:23.645812 13497 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 77 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:23.645905 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 77 FOLLOWER]: Advancing to term 78
I20260615 08:08:23.646526 13497 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 78 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.646687 13497 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 78 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:23.646899 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 78 candidate_status { last_received { term: 73 index: 14375 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:23.646916 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 78 candidate_status { last_received { term: 73 index: 14375 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:23.647162 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 78 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:23.647265 13497 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 78 FOLLOWER]: Leader election lost for term 78. Reason: could not achieve majority
I20260615 08:08:23.648734 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 78 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 76. Current term is 78. Ops: [76.14376-76.14376]
I20260615 08:08:23.649035 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 73.14375, Next index: 14376, Last known committed idx: 14375, Time since last communication: 0.000s
I20260615 08:08:23.650663 13555 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 76 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:23.650731 13555 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 76 FOLLOWER]: Advancing to term 77
I20260615 08:08:23.651306 13555 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 77 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.651482 13555 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 77 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:23.651633 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 77 candidate_status { last_received { term: 76 index: 14376 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:23.651633 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 77 candidate_status { last_received { term: 76 index: 14376 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:23.651738 13250 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 78 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 77. Current term is 78.
I20260615 08:08:23.651881 13364 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 77 election: Vote denied by peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 78 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 77. Current term is 78.
I20260615 08:08:23.651935 13364 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 77 election: Cancelling election due to peer responding with higher term
I20260615 08:08:23.651995 13555 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 77 FOLLOWER]: Advancing to term 78
I20260615 08:08:23.652588 13555 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 78 FOLLOWER]: Leader election lost for term 77. Reason: Vote denied by peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 78 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 77. Current term is 78.
I20260615 08:08:23.652690 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 78 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 76. Current term is 78. Ops: []
I20260615 08:08:23.652978 13584 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 76.14376, Next index: 14377, Last known committed idx: 14376, Time since last communication: 0.000s
W20260615 08:08:23.658567 13460 lock_manager.cc:494] Txn 4 has not acquired the partition lock after 1000ms
I20260615 08:08:23.659523 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 78 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 76. Current term is 78. Ops: [76.14377-76.14377]
I20260615 08:08:23.659535 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 78 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 76. Current term is 78. Ops: [76.14376-76.14377]
I20260615 08:08:23.659723 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 76.14376, Next index: 14377, Last known committed idx: 14376, Time since last communication: 0.000s
I20260615 08:08:23.659795 13584 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 73.14375, Next index: 14376, Last known committed idx: 14375, Time since last communication: 0.000s
I20260615 08:08:23.659898 13522 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 76 LEADER]: Stepping down as leader of term 76
I20260615 08:08:23.659936 13522 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 76 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:23.659994 13522 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14376, Committed index: 14376, Last appended: 76.14377, Last appended by leader: 14377, Current term: 76, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.660069 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 76 FOLLOWER]: Advancing to term 77
I20260615 08:08:23.682825 13584 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 77 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:23.682901 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 77 FOLLOWER]: Advancing to term 78
I20260615 08:08:23.683648 13584 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 78 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.683806 13584 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 78 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:23.684019 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 78 candidate_status { last_received { term: 76 index: 14377 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:23.684039 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 78 candidate_status { last_received { term: 76 index: 14377 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:23.684125 13250 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 78 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f in current term 78: Already voted for candidate 666bbeda390e4798abb1630585e244a1 in this term.
I20260615 08:08:23.684619 13401 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 78 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 78.
I20260615 08:08:23.684896 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 78 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1
I20260615 08:08:23.685128 13584 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 78 FOLLOWER]: Leader election won for term 78
I20260615 08:08:23.685194 13584 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 78 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:23.685251 13584 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14376, Committed index: 14376, Last appended: 76.14377, Last appended by leader: 14377, Current term: 78, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.685696 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 76 to 78. New cstate: current_term: 78 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:23.686574 13497 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 78 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:23.686631 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 78 FOLLOWER]: Advancing to term 79
I20260615 08:08:23.687111 13497 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 79 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.687252 13497 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 79 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:23.687384 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 79 candidate_status { last_received { term: 73 index: 14375 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:23.687400 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 79 candidate_status { last_received { term: 73 index: 14375 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:23.687490 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 78 FOLLOWER]: Advancing to term 79
I20260615 08:08:23.688020 13401 raft_consensus.cc:2410] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 79 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for term 79 because replica has last-logged OpId of term: 76 index: 14376, which is greater than that of the candidate, which has last-logged OpId of term: 73 index: 14375.
I20260615 08:08:23.688231 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 79 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:23.688321 13497 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 79 FOLLOWER]: Leader election lost for term 79. Reason: could not achieve majority
W20260615 08:08:23.692663 13522 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 77 current term: 78 is higher.
I20260615 08:08:23.716212 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 79 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 78. Current term is 79. Ops: []
I20260615 08:08:23.716548 13584 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14378, Last known committed idx: 14376, Time since last communication: 0.000s
I20260615 08:08:23.716665 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 79 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 78. Current term is 79. Ops: []
I20260615 08:08:23.716881 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14378, Last known committed idx: 14375, Time since last communication: 0.000s
W20260615 08:08:23.729874 13522 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 78 current term: 78 is higher.
I20260615 08:08:23.731189 13555 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 79 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:23.731283 13555 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 79 FOLLOWER]: Advancing to term 80
I20260615 08:08:23.731910 13555 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 80 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.732112 13555 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 80 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:23.732309 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 80 candidate_status { last_received { term: 76 index: 14376 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:23.732345 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 80 candidate_status { last_received { term: 76 index: 14376 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:23.732384 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 79 FOLLOWER]: Advancing to term 80
I20260615 08:08:23.733008 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 80 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 80.
I20260615 08:08:23.733222 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 80 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters: d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:23.733332 13555 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 80 FOLLOWER]: Leader election won for term 80
I20260615 08:08:23.733417 13555 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 80 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:23.733490 13555 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14376, Committed index: 14376, Last appended: 76.14376, Last appended by leader: 14376, Current term: 80, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.733994 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 78 to 80, leader changed from d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194) to b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195). New cstate: current_term: 80 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
W20260615 08:08:23.741079 13522 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 78 current term: 78 is higher.
I20260615 08:08:23.744293 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 80 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 78. Current term is 80. Ops: [76.14376-78.14378]
I20260615 08:08:23.744552 13584 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 73.14375, Next index: 14376, Last known committed idx: 14375, Time since last communication: 0.000s
I20260615 08:08:23.748049 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 80 LEADER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 78. Current term is 80. Ops: [76.14377-78.14378]
I20260615 08:08:23.748324 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 76.14376, Next index: 14377, Last known committed idx: 14376, Time since last communication: 0.000s
I20260615 08:08:23.748422 13580 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer b97b73a5f2ad444eb230680e3c3fcb6c log is divergent from this leader: its last log entry 80.14377 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14376
I20260615 08:08:23.763160 13325 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 78 LEADER]: Stepping down as leader of term 78
I20260615 08:08:23.763216 13325 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 78 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:23.763288 13325 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14376, Committed index: 14376, Last appended: 78.14378, Last appended by leader: 14378, Current term: 78, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.763389 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 78 FOLLOWER]: Advancing to term 80
I20260615 08:08:23.763674 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 80 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 73 index: 14375. Preceding OpId from leader: term: 80 index: 14377. (index mismatch)
I20260615 08:08:23.763909 13555 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14377, Last known committed idx: 14375, Time since last communication: 0.000s
I20260615 08:08:23.764334 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 80 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 78 index: 14378. Preceding OpId from leader: term: 80 index: 14377. (term mismatch)
I20260615 08:08:23.764380 13325 pending_rounds.cc:85] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f: Aborting all ops after (but not including) 14376
I20260615 08:08:23.764402 13325 pending_rounds.cc:107] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f: Aborting uncommitted PARTICIPANT_OP operation due to leader change: 76.14377
I20260615 08:08:23.764457 13325 pending_rounds.cc:107] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f: Aborting uncommitted NO_OP operation due to leader change: 78.14378
I20260615 08:08:23.764477 13325 raft_consensus.cc:2889] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 80 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260615 08:08:23.764828 13555 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14377, Last known committed idx: 14376, Time since last communication: 0.000s
I20260615 08:08:23.797610 13497 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 80 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:23.797672 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 80 FOLLOWER]: Advancing to term 81
I20260615 08:08:23.798429 13497 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 81 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.798594 13497 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 81 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:23.798741 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 81 candidate_status { last_received { term: 80 index: 14378 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:23.798806 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 81 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 80. Current term is 81. Ops: []
I20260615 08:08:23.798892 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 81 candidate_status { last_received { term: 80 index: 14378 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:23.799027 13589 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 80.14378, Next index: 14379, Last known committed idx: 14378, Time since last communication: 0.000s
I20260615 08:08:23.799067 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 81 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:23.799158 13497 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 81 FOLLOWER]: Leader election lost for term 81. Reason: could not achieve majority
I20260615 08:08:23.833577 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 81 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 80. Current term is 81. Ops: []
I20260615 08:08:23.833873 13644 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 80.14378, Next index: 14379, Last known committed idx: 14378, Time since last communication: 0.000s
I20260615 08:08:23.837397 13555 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 80 LEADER]: Stepping down as leader of term 80
I20260615 08:08:23.837460 13555 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 80 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:23.837523 13555 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14378, Committed index: 14378, Last appended: 80.14378, Last appended by leader: 14378, Current term: 80, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.837625 13555 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 80 FOLLOWER]: Advancing to term 81
I20260615 08:08:23.840481 13497 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 81 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:23.840536 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 81 FOLLOWER]: Advancing to term 82
I20260615 08:08:23.841038 13497 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 82 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.841203 13497 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 82 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:23.841378 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 82 candidate_status { last_received { term: 80 index: 14378 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:23.841463 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 82 candidate_status { last_received { term: 80 index: 14378 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:23.841557 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 81 FOLLOWER]: Advancing to term 82
I20260615 08:08:23.842083 13401 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 82 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 82.
I20260615 08:08:23.842284 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 82 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters: d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:23.842378 13497 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 82 FOLLOWER]: Leader election won for term 82
I20260615 08:08:23.842478 13497 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 82 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:23.842550 13497 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14378, Committed index: 14378, Last appended: 80.14378, Last appended by leader: 14378, Current term: 82, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.842981 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 80 to 82, leader changed from b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195) to 666bbeda390e4798abb1630585e244a1 (127.4.42.193). New cstate: current_term: 82 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:23.854000 13580 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 80 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:23.854056 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 80 FOLLOWER]: Advancing to term 81
I20260615 08:08:23.854671 13580 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 81 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.854801 13580 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 81 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:23.854983 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 81 candidate_status { last_received { term: 80 index: 14378 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:23.855013 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 81 candidate_status { last_received { term: 80 index: 14378 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:23.855083 13401 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 82 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 81. Current term is 82.
I20260615 08:08:23.855222 13289 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 81 election: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 82 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 81. Current term is 82.
I20260615 08:08:23.855260 13289 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 81 election: Cancelling election due to peer responding with higher term
I20260615 08:08:23.855325 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 81 FOLLOWER]: Advancing to term 82
I20260615 08:08:23.855786 13580 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 82 FOLLOWER]: Leader election lost for term 81. Reason: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 82 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 81. Current term is 82.
I20260615 08:08:23.868269 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 82 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 80 index: 14378. Preceding OpId from leader: term: 82 index: 14379. (index mismatch)
I20260615 08:08:23.868541 13497 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14379, Last known committed idx: 14378, Time since last communication: 0.000s
I20260615 08:08:23.876336 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 82 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 80 index: 14378. Preceding OpId from leader: term: 82 index: 14379. (index mismatch)
I20260615 08:08:23.876554 13588 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14379, Last known committed idx: 14378, Time since last communication: 0.000s
I20260615 08:08:23.907528 13580 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 82 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:23.907624 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 82 FOLLOWER]: Advancing to term 83
I20260615 08:08:23.908248 13580 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 83 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.908411 13580 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 83 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:23.908640 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 83 candidate_status { last_received { term: 82 index: 14379 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:23.908620 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 83 candidate_status { last_received { term: 82 index: 14379 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:23.908710 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 83 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 82. Current term is 83. Ops: []
I20260615 08:08:23.908967 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 83 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:23.908990 13497 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 82.14379, Next index: 14380, Last known committed idx: 14379, Time since last communication: 0.000s
I20260615 08:08:23.909081 13580 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 83 FOLLOWER]: Leader election lost for term 83. Reason: could not achieve majority
I20260615 08:08:23.941022 13468 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 82 LEADER]: Stepping down as leader of term 82
I20260615 08:08:23.941120 13468 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 82 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:23.941183 13468 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14379, Committed index: 14379, Last appended: 82.14379, Last appended by leader: 14379, Current term: 82, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.941300 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 82 FOLLOWER]: Advancing to term 83
I20260615 08:08:23.948397 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 83 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:23.948457 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 83 FOLLOWER]: Advancing to term 84
I20260615 08:08:23.948987 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 84 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.949131 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 84 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:23.949331 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 84 candidate_status { last_received { term: 82 index: 14379 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:23.949313 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 84 candidate_status { last_received { term: 82 index: 14379 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:23.949467 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 83 FOLLOWER]: Advancing to term 84
I20260615 08:08:23.949998 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 84 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 84.
I20260615 08:08:23.950203 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 84 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters: b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:23.950312 13522 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 84 FOLLOWER]: Leader election won for term 84
I20260615 08:08:23.950369 13522 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 84 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:23.950451 13522 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14379, Committed index: 14379, Last appended: 82.14379, Last appended by leader: 14379, Current term: 84, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.950918 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 82 to 84, leader changed from 666bbeda390e4798abb1630585e244a1 (127.4.42.193) to d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194). New cstate: current_term: 84 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:23.952368 13555 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 82 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:23.952430 13555 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 82 FOLLOWER]: Advancing to term 83
I20260615 08:08:23.952934 13555 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 83 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:23.953091 13555 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 83 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:23.953220 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 83 candidate_status { last_received { term: 82 index: 14379 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:23.953279 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 83 candidate_status { last_received { term: 82 index: 14379 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:23.953338 13250 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 84 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 83. Current term is 84.
I20260615 08:08:23.953497 13364 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 83 election: Vote denied by peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 84 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 83. Current term is 84.
I20260615 08:08:23.953523 13364 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 83 election: Cancelling election due to peer responding with higher term
I20260615 08:08:23.953583 13555 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 83 FOLLOWER]: Advancing to term 84
I20260615 08:08:23.954039 13555 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 84 FOLLOWER]: Leader election lost for term 83. Reason: Vote denied by peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 84 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 83. Current term is 84.
I20260615 08:08:23.976099 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 84 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 82 index: 14379. Preceding OpId from leader: term: 84 index: 14380. (index mismatch)
I20260615 08:08:23.976358 13522 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14380, Last known committed idx: 14379, Time since last communication: 0.000s
I20260615 08:08:23.977233 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 84 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 82 index: 14379. Preceding OpId from leader: term: 84 index: 14380. (index mismatch)
I20260615 08:08:23.977427 13522 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14380, Last known committed idx: 14379, Time since last communication: 0.000s
I20260615 08:08:24.088120 13555 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 84 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:24.088204 13555 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 84 FOLLOWER]: Advancing to term 85
I20260615 08:08:24.088821 13555 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 85 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.088984 13555 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 85 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:24.089135 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 85 candidate_status { last_received { term: 84 index: 14380 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:24.089155 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 85 candidate_status { last_received { term: 84 index: 14380 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:24.089402 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 85 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:24.089491 13555 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 85 FOLLOWER]: Leader election lost for term 85. Reason: could not achieve majority
I20260615 08:08:24.092919 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 85 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 84. Current term is 85. Ops: []
I20260615 08:08:24.093182 13584 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 84.14380, Next index: 14381, Last known committed idx: 14380, Time since last communication: 0.000s
I20260615 08:08:24.117380 13584 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 84 LEADER]: Stepping down as leader of term 84
I20260615 08:08:24.117444 13584 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 84 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:24.117518 13584 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14380, Committed index: 14380, Last appended: 84.14380, Last appended by leader: 14380, Current term: 84, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.117611 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 84 FOLLOWER]: Advancing to term 85
I20260615 08:08:24.134127 13555 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 85 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:24.134209 13555 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 85 FOLLOWER]: Advancing to term 86
I20260615 08:08:24.134907 13555 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 86 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.135108 13555 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 86 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:24.135340 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 86 candidate_status { last_received { term: 84 index: 14380 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:24.135340 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 86 candidate_status { last_received { term: 84 index: 14380 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:24.135468 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 85 FOLLOWER]: Advancing to term 86
I20260615 08:08:24.135987 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 86 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 86.
I20260615 08:08:24.136181 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 86 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1
I20260615 08:08:24.136284 13555 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 86 FOLLOWER]: Leader election won for term 86
I20260615 08:08:24.136363 13555 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 86 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:24.136415 13555 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14380, Committed index: 14380, Last appended: 84.14380, Last appended by leader: 14380, Current term: 86, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.136929 13146 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 84 to 86, leader changed from d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194) to b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195). New cstate: current_term: 86 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:24.143822 13468 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 84 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:24.143890 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 84 FOLLOWER]: Advancing to term 85
I20260615 08:08:24.144464 13468 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 85 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.144613 13468 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 85 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:24.144807 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 85 candidate_status { last_received { term: 84 index: 14380 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:24.144804 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 85 candidate_status { last_received { term: 84 index: 14380 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:24.144929 13325 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 86 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 85. Current term is 86.
I20260615 08:08:24.145077 13215 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 85 election: Vote denied by peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 86 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 85. Current term is 86.
I20260615 08:08:24.145113 13215 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 85 election: Cancelling election due to peer responding with higher term
I20260615 08:08:24.145174 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 85 FOLLOWER]: Advancing to term 86
I20260615 08:08:24.145695 13468 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 86 FOLLOWER]: Leader election lost for term 85. Reason: Vote denied by peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 86 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 85. Current term is 86.
I20260615 08:08:24.171124 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 86 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 84 index: 14380. Preceding OpId from leader: term: 86 index: 14381. (index mismatch)
I20260615 08:08:24.171469 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 86 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 84 index: 14380. Preceding OpId from leader: term: 86 index: 14381. (index mismatch)
I20260615 08:08:24.171453 13555 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14381, Last known committed idx: 14380, Time since last communication: 0.000s
I20260615 08:08:24.171694 13644 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14381, Last known committed idx: 14380, Time since last communication: 0.000s
I20260615 08:08:24.203035 13584 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 86 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:24.203130 13468 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 86 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:24.203150 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 86 FOLLOWER]: Advancing to term 87
I20260615 08:08:24.203166 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 86 FOLLOWER]: Advancing to term 87
I20260615 08:08:24.203946 13584 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 87 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.203946 13468 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 87 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.204116 13584 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 87 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:24.204142 13468 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 87 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:24.204284 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 87 candidate_status { last_received { term: 86 index: 14381 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:24.204325 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 87 candidate_status { last_received { term: 86 index: 14381 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:24.204341 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 87 candidate_status { last_received { term: 86 index: 14381 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:24.204325 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 87 candidate_status { last_received { term: 86 index: 14381 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:24.204384 13325 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 87 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 in current term 87: Already voted for candidate d4d7c2ebbf334b19a7f964aab04f280f in this term.
I20260615 08:08:24.204527 13250 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 87 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f in current term 87: Already voted for candidate 666bbeda390e4798abb1630585e244a1 in this term.
I20260615 08:08:24.204636 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 87 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:24.204676 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 87 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:24.204746 13468 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 87 FOLLOWER]: Leader election lost for term 87. Reason: could not achieve majority
I20260615 08:08:24.204756 13584 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 87 FOLLOWER]: Leader election lost for term 87. Reason: could not achieve majority
I20260615 08:08:24.206966 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 87 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 86. Current term is 87. Ops: []
I20260615 08:08:24.207161 13644 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 86.14381, Next index: 14382, Last known committed idx: 14381, Time since last communication: 0.000s
I20260615 08:08:24.209136 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 87 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 86. Current term is 87. Ops: []
I20260615 08:08:24.209398 13563 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 86.14381, Next index: 14382, Last known committed idx: 14381, Time since last communication: 0.000s
I20260615 08:08:24.235147 13468 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 87 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:24.235247 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 87 FOLLOWER]: Advancing to term 88
I20260615 08:08:24.235888 13468 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 88 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.236050 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 88 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 86. Current term is 88. Ops: []
I20260615 08:08:24.236115 13468 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 88 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:24.236193 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 88 candidate_status { last_received { term: 86 index: 14381 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:24.236258 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 88 candidate_status { last_received { term: 86 index: 14381 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:24.236272 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 87 FOLLOWER]: Advancing to term 88
I20260615 08:08:24.236287 13589 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 86.14381, Next index: 14382, Last known committed idx: 14381, Time since last communication: 0.000s
I20260615 08:08:24.236918 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 88 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 88.
I20260615 08:08:24.237124 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 88 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters: b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:24.237246 13468 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 88 FOLLOWER]: Leader election won for term 88
I20260615 08:08:24.237313 13468 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 88 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:24.237385 13468 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14381, Committed index: 14381, Last appended: 86.14381, Last appended by leader: 14381, Current term: 88, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.237766 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 88 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 86. Current term is 88. Ops: []
I20260615 08:08:24.237790 13146 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 86 to 88, leader changed from b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195) to 666bbeda390e4798abb1630585e244a1 (127.4.42.193). New cstate: current_term: 88 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:24.238003 13644 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 86.14381, Next index: 14382, Last known committed idx: 14381, Time since last communication: 0.000s
I20260615 08:08:24.265465 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 88 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 86. Current term is 88. Ops: []
I20260615 08:08:24.265781 13589 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 86.14381, Next index: 14382, Last known committed idx: 14381, Time since last communication: 0.000s
I20260615 08:08:24.266903 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 88 LEADER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 86. Current term is 88. Ops: []
I20260615 08:08:24.267124 13644 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 86.14381, Next index: 14382, Last known committed idx: 14381, Time since last communication: 0.000s
I20260615 08:08:24.267221 13644 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer 666bbeda390e4798abb1630585e244a1 log is divergent from this leader: its last log entry 88.14382 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14381
I20260615 08:08:24.270998 13555 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 86 LEADER]: Stepping down as leader of term 86
I20260615 08:08:24.271059 13555 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 86 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:24.271131 13555 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14381, Committed index: 14381, Last appended: 86.14381, Last appended by leader: 14381, Current term: 86, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.271242 13555 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 86 FOLLOWER]: Advancing to term 87
I20260615 08:08:24.271379 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 88 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 86 index: 14381. Preceding OpId from leader: term: 88 index: 14382. (index mismatch)
I20260615 08:08:24.271554 13468 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14382, Last known committed idx: 14381, Time since last communication: 0.000s
I20260615 08:08:24.274101 13400 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 87 FOLLOWER]: Advancing to term 88
I20260615 08:08:24.274649 13400 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 88 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 86 index: 14381. Preceding OpId from leader: term: 88 index: 14382. (index mismatch)
I20260615 08:08:24.274844 13468 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14382, Last known committed idx: 14381, Time since last communication: 0.000s
I20260615 08:08:24.326764 13584 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 88 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:24.326841 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 88 FOLLOWER]: Advancing to term 89
I20260615 08:08:24.327474 13584 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 89 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.327617 13584 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 89 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:24.327795 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 89 candidate_status { last_received { term: 88 index: 14382 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:24.327824 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 89 candidate_status { last_received { term: 88 index: 14382 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:24.328034 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 89 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:24.328140 13584 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 89 FOLLOWER]: Leader election lost for term 89. Reason: could not achieve majority
I20260615 08:08:24.331624 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 89 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 88. Current term is 89. Ops: []
I20260615 08:08:24.331818 13468 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 88.14382, Next index: 14383, Last known committed idx: 14382, Time since last communication: 0.000s
I20260615 08:08:24.338033 13588 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 88 LEADER]: Stepping down as leader of term 88
I20260615 08:08:24.338090 13588 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 88 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:24.338152 13588 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14382, Committed index: 14382, Last appended: 88.14382, Last appended by leader: 14382, Current term: 88, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.338234 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 88 FOLLOWER]: Advancing to term 89
I20260615 08:08:24.362078 13644 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 88 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:24.362143 13644 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 88 FOLLOWER]: Advancing to term 89
I20260615 08:08:24.362811 13644 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 89 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.362972 13644 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 89 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:24.363130 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 89 candidate_status { last_received { term: 88 index: 14382 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:24.363191 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 89 candidate_status { last_received { term: 88 index: 14382 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:24.363258 13325 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 89 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c in current term 89: Already voted for candidate d4d7c2ebbf334b19a7f964aab04f280f in this term.
I20260615 08:08:24.363809 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 89 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 89.
I20260615 08:08:24.364002 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 89 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters: d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:24.364117 13644 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 89 FOLLOWER]: Leader election won for term 89
I20260615 08:08:24.364182 13644 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 89 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:24.364234 13644 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14382, Committed index: 14382, Last appended: 88.14382, Last appended by leader: 14382, Current term: 89, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.364719 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 88 to 89, leader changed from 666bbeda390e4798abb1630585e244a1 (127.4.42.193) to b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195). New cstate: current_term: 89 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:24.365528 13584 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 89 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:24.365592 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 89 FOLLOWER]: Advancing to term 90
I20260615 08:08:24.366163 13584 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 90 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.366302 13584 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 90 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:24.366449 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 90 candidate_status { last_received { term: 88 index: 14382 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:24.366449 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 90 candidate_status { last_received { term: 88 index: 14382 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:24.366568 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 89 FOLLOWER]: Advancing to term 90
I20260615 08:08:24.367069 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 90 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 90.
I20260615 08:08:24.367254 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 90 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters: b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:24.367359 13584 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 90 FOLLOWER]: Leader election won for term 90
I20260615 08:08:24.367419 13584 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 90 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:24.367477 13584 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14382, Committed index: 14382, Last appended: 88.14382, Last appended by leader: 14382, Current term: 90, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.370431 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 89 to 90, leader changed from b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195) to d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194). New cstate: current_term: 90 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:24.386886 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 90 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 89. Current term is 90. Ops: []
I20260615 08:08:24.386991 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 90 LEADER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 89. Current term is 90. Ops: []
I20260615 08:08:24.387141 13644 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14383, Last known committed idx: 14382, Time since last communication: 0.000s
I20260615 08:08:24.387281 13589 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14383, Last known committed idx: 14382, Time since last communication: 0.000s
I20260615 08:08:24.387377 13589 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer d4d7c2ebbf334b19a7f964aab04f280f log is divergent from this leader: its last log entry 90.14383 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14382
W20260615 08:08:24.389703 13555 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 88 current term: 89 is higher.
I20260615 08:08:24.398319 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 90 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:24.398406 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 90 FOLLOWER]: Advancing to term 91
I20260615 08:08:24.399107 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 91 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.399276 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 91 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:24.399420 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 91 candidate_status { last_received { term: 88 index: 14382 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:24.399485 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 91 candidate_status { last_received { term: 88 index: 14382 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:24.399592 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 91 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 90. Current term is 91. Ops: []
I20260615 08:08:24.399673 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 91 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:24.399758 13588 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 91 FOLLOWER]: Leader election lost for term 91. Reason: could not achieve majority
I20260615 08:08:24.399793 13584 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14383, Last known committed idx: 14382, Time since last communication: 0.000s
I20260615 08:08:24.400141 13400 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 89 LEADER]: Stepping down as leader of term 89
I20260615 08:08:24.400178 13400 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 89 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:24.400215 13400 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14382, Committed index: 14382, Last appended: 89.14383, Last appended by leader: 14383, Current term: 89, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.400271 13400 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 89 FOLLOWER]: Advancing to term 90
I20260615 08:08:24.400712 13400 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 90 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 89 index: 14383. Preceding OpId from leader: term: 90 index: 14383. (term mismatch)
I20260615 08:08:24.400744 13400 pending_rounds.cc:85] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c: Aborting all ops after (but not including) 14382
I20260615 08:08:24.400756 13400 pending_rounds.cc:107] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c: Aborting uncommitted NO_OP operation due to leader change: 89.14383
I20260615 08:08:24.400769 13400 raft_consensus.cc:2889] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 90 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260615 08:08:24.400943 13580 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14383, Last known committed idx: 14382, Time since last communication: 0.000s
I20260615 08:08:24.428174 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 91 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 90. Current term is 91. Ops: [90.14383-90.14383]
I20260615 08:08:24.428450 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 88.14382, Next index: 14383, Last known committed idx: 14382, Time since last communication: 0.000s
I20260615 08:08:24.432011 13584 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 90 LEADER]: Stepping down as leader of term 90
I20260615 08:08:24.432054 13584 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 90 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:24.432137 13584 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14383, Committed index: 14383, Last appended: 90.14383, Last appended by leader: 14383, Current term: 90, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.432261 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 90 FOLLOWER]: Advancing to term 91
I20260615 08:08:24.440289 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 91 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:24.440348 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 91 FOLLOWER]: Advancing to term 92
I20260615 08:08:24.440909 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 92 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.441063 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 92 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:24.441228 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 92 candidate_status { last_received { term: 88 index: 14382 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:24.441228 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 92 candidate_status { last_received { term: 88 index: 14382 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:24.441318 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 91 FOLLOWER]: Advancing to term 92
I20260615 08:08:24.441833 13325 raft_consensus.cc:2410] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 92 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for term 92 because replica has last-logged OpId of term: 90 index: 14383, which is greater than that of the candidate, which has last-logged OpId of term: 88 index: 14382.
I20260615 08:08:24.442006 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 92 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:24.442090 13588 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 92 FOLLOWER]: Leader election lost for term 92. Reason: could not achieve majority
I20260615 08:08:24.456881 13555 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 90 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:24.457000 13555 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 90 FOLLOWER]: Advancing to term 91
I20260615 08:08:24.457542 13555 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 91 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.457726 13555 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 91 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:24.457872 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 91 candidate_status { last_received { term: 90 index: 14383 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:24.457892 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 91 candidate_status { last_received { term: 90 index: 14383 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:24.458024 13325 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 92 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 91. Current term is 92.
I20260615 08:08:24.458024 13250 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 92 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 91. Current term is 92.
I20260615 08:08:24.458220 13366 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 91 election: Vote denied by peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 92 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 91. Current term is 92.
I20260615 08:08:24.458284 13366 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 91 election: Cancelling election due to peer responding with higher term
I20260615 08:08:24.458340 13364 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 91 election: Vote denied by peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 92 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 91. Current term is 92.
I20260615 08:08:24.458356 13555 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 91 FOLLOWER]: Advancing to term 92
I20260615 08:08:24.458902 13555 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 92 FOLLOWER]: Leader election lost for term 91. Reason: Vote denied by peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 92 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 91. Current term is 92.
I20260615 08:08:24.464367 13584 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 92 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:24.464421 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 92 FOLLOWER]: Advancing to term 93
I20260615 08:08:24.464856 13584 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 93 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.464978 13584 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 93 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:24.465145 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 93 candidate_status { last_received { term: 90 index: 14383 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:24.465210 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 92 FOLLOWER]: Advancing to term 93
I20260615 08:08:24.465152 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 93 candidate_status { last_received { term: 90 index: 14383 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:24.465240 13400 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 92 FOLLOWER]: Advancing to term 93
I20260615 08:08:24.465662 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 93 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 93.
I20260615 08:08:24.465763 13400 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 93 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 93.
I20260615 08:08:24.465889 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 93 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters:
I20260615 08:08:24.466002 13584 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 93 FOLLOWER]: Leader election won for term 93
I20260615 08:08:24.466058 13584 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 93 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:24.466102 13584 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14382, Committed index: 14382, Last appended: 90.14383, Last appended by leader: 14383, Current term: 93, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.466605 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 90 to 93. New cstate: current_term: 93 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:24.493919 13400 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 93 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 90 index: 14383. Preceding OpId from leader: term: 93 index: 14384. (index mismatch)
I20260615 08:08:24.494263 13584 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14384, Last known committed idx: 14383, Time since last communication: 0.000s
I20260615 08:08:24.496174 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 93 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:24.496224 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 93 FOLLOWER]: Advancing to term 94
I20260615 08:08:24.496830 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 94 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.496999 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 94 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:24.497145 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 94 candidate_status { last_received { term: 88 index: 14382 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:24.497267 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 94 candidate_status { last_received { term: 88 index: 14382 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:24.497403 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 94 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:24.497524 13588 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 94 FOLLOWER]: Leader election lost for term 94. Reason: could not achieve majority
I20260615 08:08:24.501869 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 94 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 93. Current term is 94. Ops: []
I20260615 08:08:24.502228 13584 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14384, Last known committed idx: 14382, Time since last communication: 0.000s
I20260615 08:08:24.507543 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 94 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 93. Current term is 94. Ops: [90.14383-93.14384]
I20260615 08:08:24.507797 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 88.14382, Next index: 14383, Last known committed idx: 14382, Time since last communication: 0.000s
I20260615 08:08:24.526283 13555 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 93 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:24.526364 13555 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 93 FOLLOWER]: Advancing to term 94
I20260615 08:08:24.527180 13555 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 94 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.527303 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 94 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 93. Current term is 94. Ops: []
I20260615 08:08:24.527355 13555 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 94 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:24.527493 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 94 candidate_status { last_received { term: 93 index: 14384 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:24.527531 13584 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 93.14384, Next index: 14385, Last known committed idx: 14384, Time since last communication: 0.000s
I20260615 08:08:24.527590 13250 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 94 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c in current term 94: Already voted for candidate 666bbeda390e4798abb1630585e244a1 in this term.
I20260615 08:08:24.527521 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 94 candidate_status { last_received { term: 93 index: 14384 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:24.527753 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 94 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:24.527871 13555 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 94 FOLLOWER]: Leader election lost for term 94. Reason: could not achieve majority
I20260615 08:08:24.539173 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 94 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 93. Current term is 94. Ops: [90.14383-93.14384]
I20260615 08:08:24.539438 13584 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 88.14382, Next index: 14383, Last known committed idx: 14382, Time since last communication: 0.000s
I20260615 08:08:24.553206 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 94 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 93. Current term is 94. Ops: []
I20260615 08:08:24.553431 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 93.14384, Next index: 14385, Last known committed idx: 14384, Time since last communication: 0.000s
I20260615 08:08:24.558691 13555 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 94 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:24.558776 13555 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 94 FOLLOWER]: Advancing to term 95
I20260615 08:08:24.559370 13555 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 95 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.559546 13555 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 95 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:24.559684 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 95 candidate_status { last_received { term: 93 index: 14384 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:24.559746 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 94 FOLLOWER]: Advancing to term 95
I20260615 08:08:24.559702 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 95 candidate_status { last_received { term: 93 index: 14384 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:24.560284 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 95 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 95.
I20260615 08:08:24.560472 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 95 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters: d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:24.560554 13555 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 95 FOLLOWER]: Leader election won for term 95
I20260615 08:08:24.560607 13555 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 95 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:24.560653 13555 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14384, Committed index: 14384, Last appended: 93.14384, Last appended by leader: 14384, Current term: 95, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.561120 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 93 to 95, leader changed from d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194) to b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195). New cstate: current_term: 95 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:24.562314 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 95 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 93. Current term is 95. Ops: [90.14383-93.14384]
I20260615 08:08:24.562572 13584 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 88.14382, Next index: 14383, Last known committed idx: 14382, Time since last communication: 0.000s
I20260615 08:08:24.584275 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 95 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 88 index: 14382. Preceding OpId from leader: term: 95 index: 14385. (index mismatch)
I20260615 08:08:24.584544 13555 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14385, Last known committed idx: 14382, Time since last communication: 0.000s
I20260615 08:08:24.586241 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 95 LEADER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 93. Current term is 95. Ops: []
I20260615 08:08:24.586437 13584 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 93.14384, Next index: 14385, Last known committed idx: 14385, Time since last communication: 0.000s
I20260615 08:08:24.586555 13584 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer b97b73a5f2ad444eb230680e3c3fcb6c log is divergent from this leader: its last log entry 95.14385 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14385
I20260615 08:08:24.586633 13522 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 93 LEADER]: Stepping down as leader of term 93
I20260615 08:08:24.586670 13522 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 93 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:24.586727 13522 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14384, Committed index: 14384, Last appended: 93.14384, Last appended by leader: 14384, Current term: 93, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.586823 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 93 FOLLOWER]: Advancing to term 94
I20260615 08:08:24.597886 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 94 FOLLOWER]: Advancing to term 95
I20260615 08:08:24.598438 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 95 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 93 index: 14384. Preceding OpId from leader: term: 95 index: 14385. (index mismatch)
I20260615 08:08:24.598723 13555 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14385, Last known committed idx: 14384, Time since last communication: 0.000s
I20260615 08:08:24.653517 13584 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 95 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:24.653599 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 95 FOLLOWER]: Advancing to term 96
I20260615 08:08:24.654347 13584 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 96 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.654464 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 96 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 95. Current term is 96. Ops: []
I20260615 08:08:24.654538 13584 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 96 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:24.654651 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 96 candidate_status { last_received { term: 95 index: 14385 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:24.654755 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 96 candidate_status { last_received { term: 95 index: 14385 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:24.654778 13555 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 95.14385, Next index: 14386, Last known committed idx: 14385, Time since last communication: 0.000s
I20260615 08:08:24.654942 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 96 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:24.655040 13584 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 96 FOLLOWER]: Leader election lost for term 96. Reason: could not achieve majority
I20260615 08:08:24.680105 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 96 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 95. Current term is 96. Ops: []
I20260615 08:08:24.680369 13644 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 95.14385, Next index: 14386, Last known committed idx: 14385, Time since last communication: 0.000s
I20260615 08:08:24.695576 13584 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 96 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:24.695658 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 96 FOLLOWER]: Advancing to term 97
I20260615 08:08:24.696403 13584 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 97 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.696553 13584 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 97 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:24.696770 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 97 candidate_status { last_received { term: 95 index: 14385 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:24.696823 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 97 candidate_status { last_received { term: 95 index: 14385 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:24.697024 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 97 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:24.697119 13584 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 97 FOLLOWER]: Leader election lost for term 97. Reason: could not achieve majority
I20260615 08:08:24.697902 13468 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 95 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:24.697947 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 95 FOLLOWER]: Advancing to term 96
I20260615 08:08:24.698588 13468 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 96 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.698783 13468 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 96 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:24.698899 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 96 candidate_status { last_received { term: 95 index: 14385 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:24.698899 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 96 candidate_status { last_received { term: 95 index: 14385 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:24.698980 13325 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 97 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 96. Current term is 97.
I20260615 08:08:24.699139 13215 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 96 election: Vote denied by peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 97 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 96. Current term is 97.
I20260615 08:08:24.699201 13215 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 96 election: Cancelling election due to peer responding with higher term
I20260615 08:08:24.699275 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 96 FOLLOWER]: Advancing to term 97
I20260615 08:08:24.699941 13468 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 97 FOLLOWER]: Leader election lost for term 96. Reason: Vote denied by peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 97 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 96. Current term is 97.
I20260615 08:08:24.703888 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 97 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 95. Current term is 97. Ops: []
I20260615 08:08:24.704099 13644 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 95.14385, Next index: 14386, Last known committed idx: 14385, Time since last communication: 0.000s
I20260615 08:08:24.706982 13555 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 95 LEADER]: Stepping down as leader of term 95
I20260615 08:08:24.707033 13555 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 95 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:24.707103 13555 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14385, Committed index: 14385, Last appended: 95.14385, Last appended by leader: 14385, Current term: 95, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.707188 13555 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 95 FOLLOWER]: Advancing to term 96
I20260615 08:08:24.731357 13468 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 97 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:24.731421 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 97 FOLLOWER]: Advancing to term 98
I20260615 08:08:24.731943 13468 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 98 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.732107 13468 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 98 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:24.732261 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 98 candidate_status { last_received { term: 95 index: 14385 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:24.732301 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 98 candidate_status { last_received { term: 95 index: 14385 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:24.732368 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 97 FOLLOWER]: Advancing to term 98
I20260615 08:08:24.732394 13400 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 96 FOLLOWER]: Advancing to term 98
I20260615 08:08:24.732883 13400 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 98 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 98.
I20260615 08:08:24.732888 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 98 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 98.
I20260615 08:08:24.733103 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 98 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters:
I20260615 08:08:24.733197 13468 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 98 FOLLOWER]: Leader election won for term 98
I20260615 08:08:24.733270 13468 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 98 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:24.733347 13468 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14385, Committed index: 14385, Last appended: 95.14385, Last appended by leader: 14385, Current term: 98, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.733819 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 95 to 98, leader changed from b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195) to 666bbeda390e4798abb1630585e244a1 (127.4.42.193). New cstate: current_term: 98 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:24.756102 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 98 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 95 index: 14385. Preceding OpId from leader: term: 98 index: 14386. (index mismatch)
I20260615 08:08:24.756356 13468 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14386, Last known committed idx: 14385, Time since last communication: 0.000s
I20260615 08:08:24.763394 13400 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 98 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 95 index: 14385. Preceding OpId from leader: term: 98 index: 14386. (index mismatch)
I20260615 08:08:24.763605 13497 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14386, Last known committed idx: 14385, Time since last communication: 0.000s
I20260615 08:08:24.787806 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 98 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:24.787890 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 98 FOLLOWER]: Advancing to term 99
I20260615 08:08:24.788520 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 99 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.788662 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 99 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:24.788851 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 99 candidate_status { last_received { term: 98 index: 14386 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:24.788851 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 99 candidate_status { last_received { term: 98 index: 14386 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:24.789135 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 99 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:24.789278 13522 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 99 FOLLOWER]: Leader election lost for term 99. Reason: could not achieve majority
I20260615 08:08:24.789467 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 99 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 98. Current term is 99. Ops: []
I20260615 08:08:24.789661 13468 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 98.14386, Next index: 14387, Last known committed idx: 14386, Time since last communication: 0.000s
I20260615 08:08:24.824708 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 99 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 98. Current term is 99. Ops: []
I20260615 08:08:24.824995 13468 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 98.14386, Next index: 14387, Last known committed idx: 14386, Time since last communication: 0.000s
I20260615 08:08:24.829658 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 99 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:24.829708 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 99 FOLLOWER]: Advancing to term 100
I20260615 08:08:24.830453 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 100 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.830636 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 100 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:24.830816 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 100 candidate_status { last_received { term: 98 index: 14386 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:24.830823 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 100 candidate_status { last_received { term: 98 index: 14386 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:24.831091 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 100 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:24.831200 13522 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 100 FOLLOWER]: Leader election lost for term 100. Reason: could not achieve majority
W20260615 08:08:24.833787 13460 lock_manager.cc:494] Txn 6 has not acquired the partition lock after 1000ms
I20260615 08:08:24.835983 13588 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 98 LEADER]: Stepping down as leader of term 98
I20260615 08:08:24.836038 13588 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 98 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:24.836109 13588 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14386, Committed index: 14386, Last appended: 98.14386, Last appended by leader: 14386, Current term: 98, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.836201 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 98 FOLLOWER]: Advancing to term 99
I20260615 08:08:24.847295 13555 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 98 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:24.847362 13555 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 98 FOLLOWER]: Advancing to term 99
I20260615 08:08:24.847867 13555 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 99 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.848017 13555 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 99 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:24.848232 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 99 candidate_status { last_received { term: 98 index: 14386 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:24.848269 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 99 candidate_status { last_received { term: 98 index: 14386 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:24.848345 13325 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 100 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 99. Current term is 100.
I20260615 08:08:24.848524 13366 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 99 election: Vote denied by peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 100 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 99. Current term is 100.
I20260615 08:08:24.848567 13366 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 99 election: Cancelling election due to peer responding with higher term
I20260615 08:08:24.848659 13555 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 99 FOLLOWER]: Advancing to term 100
I20260615 08:08:24.848940 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 99 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 99.
I20260615 08:08:24.849213 13555 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 100 FOLLOWER]: Leader election lost for term 99. Reason: Vote denied by peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 100 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 99. Current term is 100.
I20260615 08:08:24.880702 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 99 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:24.880774 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 99 FOLLOWER]: Advancing to term 100
I20260615 08:08:24.881350 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 100 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.881502 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 100 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:24.881731 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 100 candidate_status { last_received { term: 98 index: 14386 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:24.881753 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 100 candidate_status { last_received { term: 98 index: 14386 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:24.881906 13325 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 100 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 in current term 100: Already voted for candidate d4d7c2ebbf334b19a7f964aab04f280f in this term.
I20260615 08:08:24.882396 13400 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 100 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 100.
I20260615 08:08:24.882579 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 100 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters: d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:24.882632 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 100 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:24.882696 13588 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 100 FOLLOWER]: Leader election won for term 100
I20260615 08:08:24.882688 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 100 FOLLOWER]: Advancing to term 101
I20260615 08:08:24.882805 13588 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 100 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:24.882855 13588 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14386, Committed index: 14386, Last appended: 98.14386, Last appended by leader: 14386, Current term: 100, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.883327 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 98 to 100. New cstate: current_term: 100 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:24.883445 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 101 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.883546 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 101 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:24.883682 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 101 candidate_status { last_received { term: 98 index: 14386 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:24.883715 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 101 candidate_status { last_received { term: 98 index: 14386 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:24.883780 13400 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 100 FOLLOWER]: Advancing to term 101
I20260615 08:08:24.884212 13400 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 101 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 101.
I20260615 08:08:24.884425 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 101 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1
I20260615 08:08:24.884526 13522 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 101 FOLLOWER]: Leader election won for term 101
I20260615 08:08:24.884572 13522 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 101 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:24.884613 13522 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14386, Committed index: 14386, Last appended: 98.14386, Last appended by leader: 14386, Current term: 101, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.907270 13250 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 100 LEADER]: Stepping down as leader of term 100
I20260615 08:08:24.907320 13250 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 100 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:24.907358 13250 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14386, Committed index: 14386, Last appended: 100.14387, Last appended by leader: 14387, Current term: 100, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.907454 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 100 FOLLOWER]: Advancing to term 101
I20260615 08:08:24.907945 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 101 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 100 index: 14387. Preceding OpId from leader: term: 101 index: 14387. (term mismatch)
I20260615 08:08:24.907981 13250 pending_rounds.cc:85] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1: Aborting all ops after (but not including) 14386
I20260615 08:08:24.907994 13250 pending_rounds.cc:107] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1: Aborting uncommitted NO_OP operation due to leader change: 100.14387
I20260615 08:08:24.908046 13250 raft_consensus.cc:2889] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 101 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260615 08:08:24.908289 13522 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14387, Last known committed idx: 14386, Time since last communication: 0.000s
I20260615 08:08:24.909507 13400 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 101 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 98 index: 14386. Preceding OpId from leader: term: 101 index: 14387. (index mismatch)
I20260615 08:08:24.909725 13522 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14387, Last known committed idx: 14386, Time since last communication: 0.000s
I20260615 08:08:24.913121 13146 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 100 to 101, leader changed from 666bbeda390e4798abb1630585e244a1 (127.4.42.193) to d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194). New cstate: current_term: 101 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:24.965713 13555 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 101 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:24.965823 13555 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 101 FOLLOWER]: Advancing to term 102
I20260615 08:08:24.966576 13555 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 102 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:24.966722 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 102 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 101. Current term is 102. Ops: []
I20260615 08:08:24.966747 13555 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 102 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:24.966881 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 102 candidate_status { last_received { term: 101 index: 14387 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:24.966912 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 102 candidate_status { last_received { term: 101 index: 14387 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:24.966954 13584 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 101.14387, Next index: 14388, Last known committed idx: 14387, Time since last communication: 0.000s
I20260615 08:08:24.967141 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 102 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:24.967221 13555 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 102 FOLLOWER]: Leader election lost for term 102. Reason: could not achieve majority
I20260615 08:08:24.993194 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 102 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 101. Current term is 102. Ops: []
I20260615 08:08:24.993455 13522 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 101.14387, Next index: 14388, Last known committed idx: 14387, Time since last communication: 0.000s
I20260615 08:08:25.009671 13555 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 102 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:25.009753 13555 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 102 FOLLOWER]: Advancing to term 103
I20260615 08:08:25.010536 13555 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 103 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.010684 13555 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 103 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:25.010823 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 103 candidate_status { last_received { term: 101 index: 14387 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:25.010838 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 103 candidate_status { last_received { term: 101 index: 14387 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:25.011039 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 103 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:25.011135 13555 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 103 FOLLOWER]: Leader election lost for term 103. Reason: could not achieve majority
I20260615 08:08:25.013180 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 101 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:25.013233 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 101 FOLLOWER]: Advancing to term 102
I20260615 08:08:25.013748 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 102 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.013892 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 102 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:25.014003 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 102 candidate_status { last_received { term: 101 index: 14387 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:25.014024 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 102 candidate_status { last_received { term: 101 index: 14387 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:25.014094 13400 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 103 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 102. Current term is 103.
I20260615 08:08:25.014129 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 102 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 101. Current term is 102. Ops: []
I20260615 08:08:25.014261 13213 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 102 election: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 103 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 102. Current term is 103.
I20260615 08:08:25.014297 13213 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 102 election: Cancelling election due to peer responding with higher term
I20260615 08:08:25.014309 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 101.14387, Next index: 14388, Last known committed idx: 14387, Time since last communication: 0.000s
I20260615 08:08:25.014353 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 102 FOLLOWER]: Advancing to term 103
I20260615 08:08:25.014900 13588 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 103 FOLLOWER]: Leader election lost for term 102. Reason: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 103 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 102. Current term is 103.
I20260615 08:08:25.022639 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 103 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 101. Current term is 103. Ops: []
I20260615 08:08:25.022809 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 101.14387, Next index: 14388, Last known committed idx: 14387, Time since last communication: 0.000s
I20260615 08:08:25.040899 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 103 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 101. Current term is 103. Ops: []
I20260615 08:08:25.041154 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 101.14387, Next index: 14388, Last known committed idx: 14387, Time since last communication: 0.000s
I20260615 08:08:25.048741 13522 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 101 LEADER]: Stepping down as leader of term 101
I20260615 08:08:25.048794 13522 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 101 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:25.048839 13522 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14387, Committed index: 14387, Last appended: 101.14387, Last appended by leader: 14387, Current term: 101, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.048925 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 101 FOLLOWER]: Advancing to term 102
I20260615 08:08:25.054260 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 103 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:25.054309 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 103 FOLLOWER]: Advancing to term 104
I20260615 08:08:25.054842 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 104 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.054989 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 104 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:25.055141 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 104 candidate_status { last_received { term: 101 index: 14387 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:25.055229 13400 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 103 FOLLOWER]: Advancing to term 104
I20260615 08:08:25.055147 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 104 candidate_status { last_received { term: 101 index: 14387 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:25.055327 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 102 FOLLOWER]: Advancing to term 104
I20260615 08:08:25.055855 13400 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 104 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 104.
I20260615 08:08:25.055859 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 104 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 104.
I20260615 08:08:25.056056 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 104 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters:
I20260615 08:08:25.056145 13588 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 104 FOLLOWER]: Leader election won for term 104
I20260615 08:08:25.056196 13588 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 104 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:25.056259 13588 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14387, Committed index: 14387, Last appended: 101.14387, Last appended by leader: 14387, Current term: 104, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.056730 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 101 to 104, leader changed from d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194) to 666bbeda390e4798abb1630585e244a1 (127.4.42.193). New cstate: current_term: 104 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:25.088074 13400 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 104 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 101 index: 14387. Preceding OpId from leader: term: 104 index: 14388. (index mismatch)
I20260615 08:08:25.088317 13588 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14388, Last known committed idx: 14387, Time since last communication: 0.000s
I20260615 08:08:25.089138 13584 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 104 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:25.089202 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 104 FOLLOWER]: Advancing to term 105
I20260615 08:08:25.089905 13584 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 105 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.090035 13584 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 105 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:25.090175 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 105 candidate_status { last_received { term: 101 index: 14387 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:25.090175 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 105 candidate_status { last_received { term: 101 index: 14387 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:25.090389 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 105 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:25.090517 13584 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 105 FOLLOWER]: Leader election lost for term 105. Reason: could not achieve majority
I20260615 08:08:25.091655 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 105 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 104. Current term is 105. Ops: []
I20260615 08:08:25.091885 13588 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14388, Last known committed idx: 14387, Time since last communication: 0.000s
I20260615 08:08:25.117439 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 105 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 104. Current term is 105. Ops: [104.14388-104.14388]
I20260615 08:08:25.117694 13497 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 101.14387, Next index: 14388, Last known committed idx: 14387, Time since last communication: 0.000s
I20260615 08:08:25.124821 13584 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 105 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:25.124926 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 105 FOLLOWER]: Advancing to term 106
I20260615 08:08:25.125465 13584 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 106 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.125599 13584 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 106 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:25.125768 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 106 candidate_status { last_received { term: 101 index: 14387 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:25.125808 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 106 candidate_status { last_received { term: 101 index: 14387 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:25.126019 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 106 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:25.126111 13584 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 106 FOLLOWER]: Leader election lost for term 106. Reason: could not achieve majority
I20260615 08:08:25.145249 13555 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 104 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:25.145313 13555 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 104 FOLLOWER]: Advancing to term 105
I20260615 08:08:25.145504 13588 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 104 LEADER]: Stepping down as leader of term 104
I20260615 08:08:25.145547 13588 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 104 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:25.145612 13588 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14388, Committed index: 14388, Last appended: 104.14388, Last appended by leader: 14388, Current term: 104, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.145694 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 104 FOLLOWER]: Advancing to term 105
I20260615 08:08:25.146087 13555 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 105 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.146291 13555 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 105 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:25.146360 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 105 candidate_status { last_received { term: 104 index: 14388 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:25.146360 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 105 candidate_status { last_received { term: 104 index: 14388 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:25.146454 13325 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 106 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 105. Current term is 106.
I20260615 08:08:25.146674 13366 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 105 election: Vote denied by peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 106 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 105. Current term is 106.
I20260615 08:08:25.146709 13366 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 105 election: Cancelling election due to peer responding with higher term
I20260615 08:08:25.146778 13555 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 105 FOLLOWER]: Advancing to term 106
I20260615 08:08:25.147094 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 105 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 105.
I20260615 08:08:25.147356 13555 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 106 FOLLOWER]: Leader election lost for term 105. Reason: Vote denied by peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 106 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 105. Current term is 106.
I20260615 08:08:25.177536 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 106 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:25.177608 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 106 FOLLOWER]: Advancing to term 107
I20260615 08:08:25.177697 13555 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 106 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:25.177743 13555 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 106 FOLLOWER]: Advancing to term 107
I20260615 08:08:25.178350 13555 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 107 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.178350 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 107 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.178550 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 107 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:25.178627 13555 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 107 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:25.178707 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 107 candidate_status { last_received { term: 104 index: 14388 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:25.178812 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 107 candidate_status { last_received { term: 101 index: 14387 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:25.178807 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 105 FOLLOWER]: Advancing to term 107
I20260615 08:08:25.178805 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 107 candidate_status { last_received { term: 104 index: 14388 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:25.178956 13325 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 107 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c in current term 107: Already voted for candidate d4d7c2ebbf334b19a7f964aab04f280f in this term.
I20260615 08:08:25.179419 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 107 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 107.
I20260615 08:08:25.178830 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 107 candidate_status { last_received { term: 101 index: 14387 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:25.179575 13400 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 107 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f in current term 107: Already voted for candidate b97b73a5f2ad444eb230680e3c3fcb6c in this term.
I20260615 08:08:25.179616 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 107 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters: d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:25.179767 13555 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 107 FOLLOWER]: Leader election won for term 107
I20260615 08:08:25.179768 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 107 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:25.179832 13555 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 107 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:25.179906 13555 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14388, Committed index: 14388, Last appended: 104.14388, Last appended by leader: 14388, Current term: 107, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.179965 13522 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 107 FOLLOWER]: Leader election lost for term 107. Reason: could not achieve majority
I20260615 08:08:25.180441 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 104 to 107, leader changed from 666bbeda390e4798abb1630585e244a1 (127.4.42.193) to b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195). New cstate: current_term: 107 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:25.209141 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 107 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 104 index: 14388. Preceding OpId from leader: term: 107 index: 14389. (index mismatch)
I20260615 08:08:25.209470 13555 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14389, Last known committed idx: 14388, Time since last communication: 0.000s
I20260615 08:08:25.211685 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 107 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 101 index: 14387. Preceding OpId from leader: term: 107 index: 14389. (index mismatch)
I20260615 08:08:25.211870 13555 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14389, Last known committed idx: 14387, Time since last communication: 0.000s
I20260615 08:08:25.321038 13584 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 107 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:25.321147 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 107 FOLLOWER]: Advancing to term 108
I20260615 08:08:25.321772 13584 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 108 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.321955 13584 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 108 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:25.322198 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 108 candidate_status { last_received { term: 107 index: 14389 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:25.322156 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 108 candidate_status { last_received { term: 107 index: 14389 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:25.322499 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 108 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:25.322660 13584 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 108 FOLLOWER]: Leader election lost for term 108. Reason: could not achieve majority
I20260615 08:08:25.324877 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 108 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 107. Current term is 108. Ops: []
I20260615 08:08:25.325098 13589 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 107.14389, Next index: 14390, Last known committed idx: 14389, Time since last communication: 0.000s
I20260615 08:08:25.344337 13654 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 107 LEADER]: Stepping down as leader of term 107
I20260615 08:08:25.344390 13654 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 107 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:25.344437 13654 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14389, Committed index: 14389, Last appended: 107.14389, Last appended by leader: 14389, Current term: 107, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.344529 13654 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 107 FOLLOWER]: Advancing to term 108
I20260615 08:08:25.349762 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 107 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:25.349817 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 107 FOLLOWER]: Advancing to term 108
I20260615 08:08:25.350345 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 108 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.350502 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 108 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:25.350656 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 108 candidate_status { last_received { term: 107 index: 14389 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:25.350656 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 108 candidate_status { last_received { term: 107 index: 14389 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:25.350759 13325 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 108 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 in current term 108: Already voted for candidate d4d7c2ebbf334b19a7f964aab04f280f in this term.
I20260615 08:08:25.351263 13400 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 108 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 108.
I20260615 08:08:25.351436 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 108 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters: d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:25.351524 13588 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 108 FOLLOWER]: Leader election won for term 108
I20260615 08:08:25.351591 13588 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 108 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:25.351647 13588 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14389, Committed index: 14389, Last appended: 107.14389, Last appended by leader: 14389, Current term: 108, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.352064 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 107 to 108, leader changed from b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195) to 666bbeda390e4798abb1630585e244a1 (127.4.42.193). New cstate: current_term: 108 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:25.366073 13584 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 108 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:25.366150 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 108 FOLLOWER]: Advancing to term 109
I20260615 08:08:25.366752 13584 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 109 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.366892 13584 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 109 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:25.367079 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 109 candidate_status { last_received { term: 107 index: 14389 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:25.367077 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 109 candidate_status { last_received { term: 107 index: 14389 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:25.367177 13400 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 108 FOLLOWER]: Advancing to term 109
I20260615 08:08:25.367683 13400 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 109 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 109.
I20260615 08:08:25.367872 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 109 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1
I20260615 08:08:25.367956 13584 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 109 FOLLOWER]: Leader election won for term 109
I20260615 08:08:25.368009 13584 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 109 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:25.368078 13584 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14389, Committed index: 14389, Last appended: 107.14389, Last appended by leader: 14389, Current term: 109, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.370752 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 108 to 109, leader changed from 666bbeda390e4798abb1630585e244a1 (127.4.42.193) to d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194). New cstate: current_term: 109 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:25.374171 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 109 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 108. Current term is 109. Ops: []
I20260615 08:08:25.374394 13588 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14390, Last known committed idx: 14389, Time since last communication: 0.000s
I20260615 08:08:25.384442 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 109 LEADER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 108. Current term is 109. Ops: []
I20260615 08:08:25.384632 13468 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14390, Last known committed idx: 14389, Time since last communication: 0.000s
I20260615 08:08:25.384725 13468 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer d4d7c2ebbf334b19a7f964aab04f280f log is divergent from this leader: its last log entry 109.14390 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14389
I20260615 08:08:25.394920 13400 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 109 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 107 index: 14389. Preceding OpId from leader: term: 109 index: 14390. (index mismatch)
I20260615 08:08:25.395143 13584 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14390, Last known committed idx: 14389, Time since last communication: 0.000s
I20260615 08:08:25.397957 13250 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 108 LEADER]: Stepping down as leader of term 108
I20260615 08:08:25.398020 13250 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 108 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:25.398077 13250 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14389, Committed index: 14389, Last appended: 108.14390, Last appended by leader: 14390, Current term: 108, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.398157 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 108 FOLLOWER]: Advancing to term 109
I20260615 08:08:25.398698 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 109 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 108 index: 14390. Preceding OpId from leader: term: 109 index: 14390. (term mismatch)
I20260615 08:08:25.398763 13250 pending_rounds.cc:85] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1: Aborting all ops after (but not including) 14389
I20260615 08:08:25.398787 13250 pending_rounds.cc:107] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1: Aborting uncommitted NO_OP operation due to leader change: 108.14390
I20260615 08:08:25.398818 13250 raft_consensus.cc:2889] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 109 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260615 08:08:25.399020 13584 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14390, Last known committed idx: 14389, Time since last communication: 0.000s
I20260615 08:08:25.449672 13654 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 109 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:25.449736 13654 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 109 FOLLOWER]: Advancing to term 110
I20260615 08:08:25.450289 13654 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 110 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.450435 13654 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 110 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:25.450609 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 110 candidate_status { last_received { term: 109 index: 14390 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:25.450609 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 110 candidate_status { last_received { term: 109 index: 14390 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:25.450814 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 110 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:25.450925 13654 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 110 FOLLOWER]: Leader election lost for term 110. Reason: could not achieve majority
I20260615 08:08:25.453426 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 110 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 109. Current term is 110. Ops: []
I20260615 08:08:25.453620 13522 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 109.14390, Next index: 14391, Last known committed idx: 14390, Time since last communication: 0.000s
I20260615 08:08:25.475694 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 109 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:25.475751 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 109 FOLLOWER]: Advancing to term 110
I20260615 08:08:25.476369 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 110 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.476521 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 110 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:25.476667 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 110 candidate_status { last_received { term: 109 index: 14390 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:25.476675 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 110 candidate_status { last_received { term: 109 index: 14390 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:25.476779 13400 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 110 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 in current term 110: Already voted for candidate b97b73a5f2ad444eb230680e3c3fcb6c in this term.
I20260615 08:08:25.476941 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 110 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:25.477073 13588 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 110 FOLLOWER]: Leader election lost for term 110. Reason: could not achieve majority
I20260615 08:08:25.482134 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 110 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 109. Current term is 110. Ops: []
I20260615 08:08:25.482376 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 109.14390, Next index: 14391, Last known committed idx: 14390, Time since last communication: 0.000s
I20260615 08:08:25.484552 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 110 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 109. Current term is 110. Ops: []
I20260615 08:08:25.484750 13522 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 109.14390, Next index: 14391, Last known committed idx: 14390, Time since last communication: 0.000s
I20260615 08:08:25.493249 13654 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 110 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:25.493324 13654 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 110 FOLLOWER]: Advancing to term 111
I20260615 08:08:25.493867 13654 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 111 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.494017 13654 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 111 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:25.494149 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 111 candidate_status { last_received { term: 109 index: 14390 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:25.494154 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 111 candidate_status { last_received { term: 109 index: 14390 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:25.494227 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 110 FOLLOWER]: Advancing to term 111
I20260615 08:08:25.494781 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 111 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 111.
I20260615 08:08:25.494984 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 111 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters: d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:25.495095 13654 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 111 FOLLOWER]: Leader election won for term 111
I20260615 08:08:25.495170 13654 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 111 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:25.495234 13654 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14390, Committed index: 14390, Last appended: 109.14390, Last appended by leader: 14390, Current term: 111, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.495621 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 109 to 111, leader changed from d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194) to b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195). New cstate: current_term: 111 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:25.509817 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 111 LEADER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 109. Current term is 111. Ops: []
I20260615 08:08:25.510036 13522 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 109.14390, Next index: 14391, Last known committed idx: 14390, Time since last communication: 0.000s
I20260615 08:08:25.510133 13522 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer b97b73a5f2ad444eb230680e3c3fcb6c log is divergent from this leader: its last log entry 111.14391 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14390
I20260615 08:08:25.513419 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 111 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 109. Current term is 111. Ops: []
I20260615 08:08:25.513620 13522 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 109.14390, Next index: 14391, Last known committed idx: 14390, Time since last communication: 0.000s
I20260615 08:08:25.516335 13584 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 109 LEADER]: Stepping down as leader of term 109
I20260615 08:08:25.516378 13584 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 109 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:25.516443 13584 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14390, Committed index: 14390, Last appended: 109.14390, Last appended by leader: 14390, Current term: 109, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.516520 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 109 FOLLOWER]: Advancing to term 110
I20260615 08:08:25.526098 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 110 FOLLOWER]: Advancing to term 111
I20260615 08:08:25.526623 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 111 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 109 index: 14390. Preceding OpId from leader: term: 111 index: 14391. (index mismatch)
I20260615 08:08:25.526837 13654 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14391, Last known committed idx: 14390, Time since last communication: 0.000s
I20260615 08:08:25.527851 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 111 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 109 index: 14390. Preceding OpId from leader: term: 111 index: 14391. (index mismatch)
I20260615 08:08:25.528030 13654 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14391, Last known committed idx: 14390, Time since last communication: 0.000s
I20260615 08:08:25.558847 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 111 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:25.558907 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 111 FOLLOWER]: Advancing to term 112
I20260615 08:08:25.559413 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 112 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.559558 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 112 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:25.559711 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 112 candidate_status { last_received { term: 111 index: 14391 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:25.559727 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 112 candidate_status { last_received { term: 111 index: 14391 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:25.559927 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 112 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:25.560020 13588 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 112 FOLLOWER]: Leader election lost for term 112. Reason: could not achieve majority
I20260615 08:08:25.564988 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 112 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 111. Current term is 112. Ops: []
I20260615 08:08:25.565187 13555 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 111.14391, Next index: 14392, Last known committed idx: 14391, Time since last communication: 0.000s
I20260615 08:08:25.588701 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 112 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 111. Current term is 112. Ops: []
I20260615 08:08:25.588945 13589 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 111.14391, Next index: 14392, Last known committed idx: 14391, Time since last communication: 0.000s
I20260615 08:08:25.597076 13654 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 111 LEADER]: Stepping down as leader of term 111
I20260615 08:08:25.597137 13654 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 111 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:25.597229 13654 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14391, Committed index: 14391, Last appended: 111.14391, Last appended by leader: 14391, Current term: 111, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.597319 13654 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 111 FOLLOWER]: Advancing to term 112
I20260615 08:08:25.603536 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 112 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:25.603590 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 112 FOLLOWER]: Advancing to term 113
I20260615 08:08:25.604135 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 113 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.604285 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 113 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:25.604467 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 113 candidate_status { last_received { term: 111 index: 14391 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:25.604485 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 113 candidate_status { last_received { term: 111 index: 14391 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:25.604579 13400 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 112 FOLLOWER]: Advancing to term 113
I20260615 08:08:25.605059 13400 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 113 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 113.
I20260615 08:08:25.605253 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 113 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters: d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:25.605360 13588 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 113 FOLLOWER]: Leader election won for term 113
I20260615 08:08:25.605436 13588 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 113 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:25.605504 13588 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14391, Committed index: 14391, Last appended: 111.14391, Last appended by leader: 14391, Current term: 113, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.605932 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 111 to 113, leader changed from b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195) to 666bbeda390e4798abb1630585e244a1 (127.4.42.193). New cstate: current_term: 113 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:25.610991 13584 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 111 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:25.611068 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 111 FOLLOWER]: Advancing to term 112
I20260615 08:08:25.611570 13584 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 112 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.611716 13584 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 112 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:25.611871 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 112 candidate_status { last_received { term: 111 index: 14391 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:25.611905 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 112 candidate_status { last_received { term: 111 index: 14391 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:25.611963 13400 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 113 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 112. Current term is 113.
I20260615 08:08:25.612155 13289 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 112 election: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 113 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 112. Current term is 113.
I20260615 08:08:25.612190 13289 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 112 election: Cancelling election due to peer responding with higher term
I20260615 08:08:25.612257 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 112 FOLLOWER]: Advancing to term 113
I20260615 08:08:25.612715 13584 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 113 FOLLOWER]: Leader election lost for term 112. Reason: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 113 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 112. Current term is 113.
I20260615 08:08:25.641217 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 113 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 111 index: 14391. Preceding OpId from leader: term: 113 index: 14392. (index mismatch)
I20260615 08:08:25.641484 13588 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14392, Last known committed idx: 14391, Time since last communication: 0.000s
I20260615 08:08:25.642257 13400 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 113 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 111 index: 14391. Preceding OpId from leader: term: 113 index: 14392. (index mismatch)
I20260615 08:08:25.642462 13588 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14392, Last known committed idx: 14391, Time since last communication: 0.000s
I20260615 08:08:25.673064 13654 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 113 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:25.673136 13654 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 113 FOLLOWER]: Advancing to term 114
I20260615 08:08:25.673763 13654 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 114 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.673921 13654 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 114 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:25.674050 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 114 candidate_status { last_received { term: 113 index: 14392 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:25.674072 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 114 candidate_status { last_received { term: 113 index: 14392 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:25.674407 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 114 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:25.674561 13654 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 114 FOLLOWER]: Leader election lost for term 114. Reason: could not achieve majority
I20260615 08:08:25.679932 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 114 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 113. Current term is 114. Ops: []
I20260615 08:08:25.680194 13588 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 113.14392, Next index: 14393, Last known committed idx: 14392, Time since last communication: 0.000s
I20260615 08:08:25.702848 13400 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 114 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 113. Current term is 114. Ops: []
I20260615 08:08:25.703086 13497 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 113.14392, Next index: 14393, Last known committed idx: 14392, Time since last communication: 0.000s
I20260615 08:08:25.710999 13654 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 114 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:25.711057 13654 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 114 FOLLOWER]: Advancing to term 115
I20260615 08:08:25.711696 13654 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 115 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.711861 13468 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 113 LEADER]: Stepping down as leader of term 113
I20260615 08:08:25.711860 13654 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 115 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:25.711951 13468 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 113 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:25.711989 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 115 candidate_status { last_received { term: 113 index: 14392 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:25.712010 13468 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14392, Committed index: 14392, Last appended: 113.14392, Last appended by leader: 14392, Current term: 113, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.712039 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 115 candidate_status { last_received { term: 113 index: 14392 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:25.712090 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 113 FOLLOWER]: Advancing to term 114
I20260615 08:08:25.712698 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 114 FOLLOWER]: Advancing to term 115
I20260615 08:08:25.713156 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 115 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 115.
I20260615 08:08:25.713353 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 115 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters: d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:25.713449 13654 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 115 FOLLOWER]: Leader election won for term 115
I20260615 08:08:25.713510 13654 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 115 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:25.713557 13654 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14392, Committed index: 14392, Last appended: 113.14392, Last appended by leader: 14392, Current term: 115, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.713986 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 113 to 115, leader changed from 666bbeda390e4798abb1630585e244a1 (127.4.42.193) to b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195). New cstate: current_term: 115 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:25.723383 13584 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 113 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:25.723440 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 113 FOLLOWER]: Advancing to term 114
I20260615 08:08:25.723946 13584 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 114 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.724088 13584 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 114 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:25.724252 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 114 candidate_status { last_received { term: 113 index: 14392 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:25.724328 13250 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 115 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 114. Current term is 115.
I20260615 08:08:25.724272 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 114 candidate_status { last_received { term: 113 index: 14392 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:25.724539 13289 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 114 election: Vote denied by peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 115 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 114. Current term is 115.
I20260615 08:08:25.724614 13289 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 114 election: Cancelling election due to peer responding with higher term
I20260615 08:08:25.724675 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 114 FOLLOWER]: Advancing to term 115
I20260615 08:08:25.725204 13584 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 115 FOLLOWER]: Leader election lost for term 114. Reason: Vote denied by peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 115 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 114. Current term is 115.
I20260615 08:08:25.742380 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 115 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 113 index: 14392. Preceding OpId from leader: term: 115 index: 14393. (index mismatch)
I20260615 08:08:25.742684 13654 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14393, Last known committed idx: 14392, Time since last communication: 0.000s
I20260615 08:08:25.743942 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 115 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 113 index: 14392. Preceding OpId from leader: term: 115 index: 14393. (index mismatch)
I20260615 08:08:25.744110 13654 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14393, Last known committed idx: 14392, Time since last communication: 0.000s
I20260615 08:08:25.774701 13584 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 115 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:25.774762 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 115 FOLLOWER]: Advancing to term 116
I20260615 08:08:25.774880 13468 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 115 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:25.774928 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 115 FOLLOWER]: Advancing to term 116
I20260615 08:08:25.775533 13468 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 116 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.775534 13584 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 116 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.775719 13468 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 116 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:25.775820 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 116 candidate_status { last_received { term: 115 index: 14393 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:25.775889 13325 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 116 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 in current term 116: Already voted for candidate d4d7c2ebbf334b19a7f964aab04f280f in this term.
I20260615 08:08:25.775918 13584 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 116 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:25.775852 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 116 candidate_status { last_received { term: 115 index: 14393 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:25.776074 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 116 candidate_status { last_received { term: 115 index: 14393 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:25.775852 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 116 candidate_status { last_received { term: 115 index: 14393 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:25.776134 13250 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 116 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f in current term 116: Already voted for candidate 666bbeda390e4798abb1630585e244a1 in this term.
I20260615 08:08:25.776234 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 116 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:25.776268 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 116 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:25.776340 13468 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 116 FOLLOWER]: Leader election lost for term 116. Reason: could not achieve majority
I20260615 08:08:25.776346 13584 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 116 FOLLOWER]: Leader election lost for term 116. Reason: could not achieve majority
I20260615 08:08:25.777231 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 116 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 115. Current term is 116. Ops: []
I20260615 08:08:25.777451 13589 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 115.14393, Next index: 14394, Last known committed idx: 14393, Time since last communication: 0.000s
I20260615 08:08:25.777583 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 116 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 115. Current term is 116. Ops: []
I20260615 08:08:25.777776 13589 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 115.14393, Next index: 14394, Last known committed idx: 14393, Time since last communication: 0.000s
I20260615 08:08:25.804049 13654 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 115 LEADER]: Stepping down as leader of term 115
I20260615 08:08:25.804100 13654 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 115 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:25.804140 13654 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14393, Committed index: 14393, Last appended: 115.14393, Last appended by leader: 14393, Current term: 115, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.804201 13654 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 115 FOLLOWER]: Advancing to term 116
I20260615 08:08:25.808766 13468 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 116 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:25.808820 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 116 FOLLOWER]: Advancing to term 117
I20260615 08:08:25.809299 13468 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 117 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.809437 13468 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 117 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:25.809574 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 117 candidate_status { last_received { term: 115 index: 14393 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:25.809662 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 116 FOLLOWER]: Advancing to term 117
I20260615 08:08:25.809677 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 117 candidate_status { last_received { term: 115 index: 14393 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:25.809731 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 116 FOLLOWER]: Advancing to term 117
I20260615 08:08:25.810336 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 117 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 117.
I20260615 08:08:25.810336 13401 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 117 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 117.
I20260615 08:08:25.810546 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 117 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters:
I20260615 08:08:25.810672 13468 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 117 FOLLOWER]: Leader election won for term 117
I20260615 08:08:25.810738 13468 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 117 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:25.810789 13468 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14393, Committed index: 14393, Last appended: 115.14393, Last appended by leader: 14393, Current term: 117, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.811173 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 115 to 117, leader changed from b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195) to 666bbeda390e4798abb1630585e244a1 (127.4.42.193). New cstate: current_term: 117 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
W20260615 08:08:25.834829 13459 lock_manager.cc:494] Txn 6 has not acquired the partition lock after 1000ms
I20260615 08:08:25.835484 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 117 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 115 index: 14393. Preceding OpId from leader: term: 117 index: 14394. (index mismatch)
I20260615 08:08:25.835661 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 117 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 115 index: 14393. Preceding OpId from leader: term: 117 index: 14395. (index mismatch)
I20260615 08:08:25.835687 13468 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14394, Last known committed idx: 14393, Time since last communication: 0.000s
I20260615 08:08:25.835944 13468 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14394, Last known committed idx: 14393, Time since last communication: 0.000s
I20260615 08:08:25.867189 13584 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 117 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:25.867266 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 117 FOLLOWER]: Advancing to term 118
I20260615 08:08:25.867869 13584 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 118 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.868012 13584 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 118 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:25.868152 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 118 candidate_status { last_received { term: 117 index: 14395 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:25.868276 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 118 candidate_status { last_received { term: 117 index: 14395 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:25.868345 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 118 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 117. Current term is 118. Ops: []
I20260615 08:08:25.868435 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 118 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:25.868511 13584 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 118 FOLLOWER]: Leader election lost for term 118. Reason: could not achieve majority
I20260615 08:08:25.868605 13588 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 117.14395, Next index: 14396, Last known committed idx: 14395, Time since last communication: 0.000s
I20260615 08:08:25.891996 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 118 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 117. Current term is 118. Ops: []
I20260615 08:08:25.892268 13468 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 117.14395, Next index: 14396, Last known committed idx: 14395, Time since last communication: 0.000s
I20260615 08:08:25.903952 13584 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 118 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:25.904011 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 118 FOLLOWER]: Advancing to term 119
I20260615 08:08:25.904593 13584 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 119 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.904732 13584 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 119 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:25.904903 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 119 candidate_status { last_received { term: 117 index: 14395 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:25.904944 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 119 candidate_status { last_received { term: 117 index: 14395 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:25.905165 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 119 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:25.905259 13584 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 119 FOLLOWER]: Leader election lost for term 119. Reason: could not achieve majority
I20260615 08:08:25.916599 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 119 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 117. Current term is 119. Ops: []
I20260615 08:08:25.916868 13497 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 117.14395, Next index: 14396, Last known committed idx: 14395, Time since last communication: 0.000s
I20260615 08:08:25.922618 13654 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 117 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:25.922681 13654 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 117 FOLLOWER]: Advancing to term 118
I20260615 08:08:25.923235 13654 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 118 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.923391 13654 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 118 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:25.923527 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 118 candidate_status { last_received { term: 117 index: 14395 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:25.923547 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 118 candidate_status { last_received { term: 117 index: 14395 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:25.923635 13325 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 119 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 118. Current term is 119.
I20260615 08:08:25.923846 13366 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 118 election: Vote denied by peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 119 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 118. Current term is 119.
I20260615 08:08:25.923879 13366 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 118 election: Cancelling election due to peer responding with higher term
I20260615 08:08:25.923940 13654 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 118 FOLLOWER]: Advancing to term 119
I20260615 08:08:25.924414 13654 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 119 FOLLOWER]: Leader election lost for term 118. Reason: Vote denied by peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 119 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 118. Current term is 119.
I20260615 08:08:25.926757 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 119 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 117. Current term is 119. Ops: []
I20260615 08:08:25.926945 13588 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 117.14395, Next index: 14396, Last known committed idx: 14395, Time since last communication: 0.000s
I20260615 08:08:25.939849 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 119 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 117. Current term is 119. Ops: []
I20260615 08:08:25.940075 13497 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 117.14395, Next index: 14396, Last known committed idx: 14395, Time since last communication: 0.000s
I20260615 08:08:25.946020 13468 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 117 LEADER]: Stepping down as leader of term 117
I20260615 08:08:25.946067 13468 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 117 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:25.946134 13468 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14395, Committed index: 14395, Last appended: 117.14395, Last appended by leader: 14395, Current term: 117, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.946223 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 117 FOLLOWER]: Advancing to term 118
I20260615 08:08:25.954766 13584 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 119 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:25.954826 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 119 FOLLOWER]: Advancing to term 120
I20260615 08:08:25.955299 13584 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 120 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.955444 13584 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 120 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:25.955614 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 120 candidate_status { last_received { term: 117 index: 14395 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:25.955669 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 119 FOLLOWER]: Advancing to term 120
I20260615 08:08:25.955633 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 120 candidate_status { last_received { term: 117 index: 14395 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:25.955714 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 118 FOLLOWER]: Advancing to term 120
I20260615 08:08:25.956158 13401 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 120 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 120.
I20260615 08:08:25.956313 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 120 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 120.
I20260615 08:08:25.956341 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 120 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f; no voters:
I20260615 08:08:25.956451 13584 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 120 FOLLOWER]: Leader election won for term 120
I20260615 08:08:25.956529 13584 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 120 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:25.956585 13584 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14395, Committed index: 14395, Last appended: 117.14395, Last appended by leader: 14395, Current term: 120, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.956976 13146 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 117 to 120, leader changed from 666bbeda390e4798abb1630585e244a1 (127.4.42.193) to d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194). New cstate: current_term: 120 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:25.979144 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 120 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 117 index: 14395. Preceding OpId from leader: term: 120 index: 14396. (index mismatch)
I20260615 08:08:25.979416 13584 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14396, Last known committed idx: 14395, Time since last communication: 0.000s
I20260615 08:08:25.989547 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 120 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:25.989601 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 120 FOLLOWER]: Advancing to term 121
I20260615 08:08:25.990182 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 121 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:25.990325 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 121 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:25.990450 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 121 candidate_status { last_received { term: 117 index: 14395 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:25.990509 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 121 candidate_status { last_received { term: 117 index: 14395 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:25.990725 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 121 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:25.990823 13588 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 121 FOLLOWER]: Leader election lost for term 121. Reason: could not achieve majority
I20260615 08:08:25.993106 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 121 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 120. Current term is 121. Ops: []
I20260615 08:08:25.993310 13584 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14396, Last known committed idx: 14395, Time since last communication: 0.000s
I20260615 08:08:26.013608 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 121 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 120. Current term is 121. Ops: [120.14396-120.14396]
I20260615 08:08:26.013863 13522 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 117.14395, Next index: 14396, Last known committed idx: 14395, Time since last communication: 0.000s
I20260615 08:08:26.030925 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 121 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:26.030997 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 121 FOLLOWER]: Advancing to term 122
I20260615 08:08:26.031764 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 122 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.031911 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 122 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:26.032016 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 122 candidate_status { last_received { term: 117 index: 14395 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:26.032056 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 122 candidate_status { last_received { term: 117 index: 14395 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:26.032285 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 122 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:26.032402 13588 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 122 FOLLOWER]: Leader election lost for term 122. Reason: could not achieve majority
I20260615 08:08:26.048727 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 122 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 120. Current term is 122. Ops: [120.14396-120.14396]
I20260615 08:08:26.048980 13584 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 117.14395, Next index: 14396, Last known committed idx: 14395, Time since last communication: 0.000s
I20260615 08:08:26.065762 13522 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 120 LEADER]: Stepping down as leader of term 120
I20260615 08:08:26.065815 13468 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 122 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:26.065889 13522 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 120 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:26.065908 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 122 FOLLOWER]: Advancing to term 123
I20260615 08:08:26.065976 13522 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14396, Committed index: 14396, Last appended: 120.14396, Last appended by leader: 14396, Current term: 120, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.066111 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 120 FOLLOWER]: Advancing to term 121
I20260615 08:08:26.066772 13468 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 123 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.066936 13468 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 123 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:26.067117 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 123 candidate_status { last_received { term: 117 index: 14395 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:26.067229 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 121 FOLLOWER]: Advancing to term 123
I20260615 08:08:26.067138 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 123 candidate_status { last_received { term: 117 index: 14395 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:26.067800 13325 raft_consensus.cc:2410] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 123 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for term 123 because replica has last-logged OpId of term: 120 index: 14396, which is greater than that of the candidate, which has last-logged OpId of term: 117 index: 14395.
I20260615 08:08:26.068058 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 123 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:26.068171 13468 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 123 FOLLOWER]: Leader election lost for term 123. Reason: could not achieve majority
I20260615 08:08:26.087715 13654 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 120 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:26.087791 13654 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 120 FOLLOWER]: Advancing to term 121
I20260615 08:08:26.088461 13654 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 121 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.088641 13654 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 121 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:26.088798 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 121 candidate_status { last_received { term: 120 index: 14396 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:26.088829 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 121 candidate_status { last_received { term: 120 index: 14396 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:26.088910 13325 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 123 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 121. Current term is 123.
I20260615 08:08:26.088930 13250 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 123 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 121. Current term is 123.
I20260615 08:08:26.089083 13366 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 121 election: Vote denied by peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 123 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 121. Current term is 123.
I20260615 08:08:26.089160 13366 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 121 election: Cancelling election due to peer responding with higher term
I20260615 08:08:26.089195 13364 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 121 election: Vote denied by peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 123 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 121. Current term is 123.
I20260615 08:08:26.089236 13654 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 121 FOLLOWER]: Advancing to term 123
I20260615 08:08:26.089708 13654 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 123 FOLLOWER]: Leader election lost for term 121. Reason: Vote denied by peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 123 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 121. Current term is 123.
I20260615 08:08:26.090344 13580 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 123 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:26.090391 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 123 FOLLOWER]: Advancing to term 124
I20260615 08:08:26.091516 13580 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 124 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.091665 13580 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 124 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:26.091836 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 124 candidate_status { last_received { term: 120 index: 14396 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:26.091897 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 123 FOLLOWER]: Advancing to term 124
I20260615 08:08:26.091876 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 124 candidate_status { last_received { term: 120 index: 14396 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:26.091945 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 123 FOLLOWER]: Advancing to term 124
I20260615 08:08:26.092414 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 124 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 124.
I20260615 08:08:26.092552 13401 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 124 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 124.
I20260615 08:08:26.092609 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 124 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters:
I20260615 08:08:26.092711 13580 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 124 FOLLOWER]: Leader election won for term 124
I20260615 08:08:26.092792 13580 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 124 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:26.092845 13580 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14396, Committed index: 14396, Last appended: 120.14396, Last appended by leader: 14396, Current term: 124, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.093281 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 120 to 124. New cstate: current_term: 124 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
W20260615 08:08:26.106892 13522 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 121 current term: 124 is higher.
I20260615 08:08:26.119711 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 124 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 120 index: 14396. Preceding OpId from leader: term: 124 index: 14397. (index mismatch)
I20260615 08:08:26.119992 13580 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14397, Last known committed idx: 14396, Time since last communication: 0.000s
I20260615 08:08:26.120690 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 124 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 117 index: 14395. Preceding OpId from leader: term: 124 index: 14397. (index mismatch)
I20260615 08:08:26.120877 13584 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14397, Last known committed idx: 14395, Time since last communication: 0.000s
W20260615 08:08:26.148103 13522 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 122 current term: 124 is higher.
I20260615 08:08:26.151425 13654 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 124 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:26.151516 13654 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 124 FOLLOWER]: Advancing to term 125
I20260615 08:08:26.151827 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 124 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:26.151901 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 124 FOLLOWER]: Advancing to term 125
I20260615 08:08:26.152392 13654 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 125 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.152576 13654 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 125 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:26.152621 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 125 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.152755 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 125 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:26.152810 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 125 candidate_status { last_received { term: 124 index: 14397 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:26.152830 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 125 candidate_status { last_received { term: 124 index: 14397 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:26.152871 13250 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 125 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c in current term 125: Already voted for candidate 666bbeda390e4798abb1630585e244a1 in this term.
I20260615 08:08:26.152878 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 125 candidate_status { last_received { term: 124 index: 14397 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:26.152973 13401 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 125 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 in current term 125: Already voted for candidate b97b73a5f2ad444eb230680e3c3fcb6c in this term.
I20260615 08:08:26.152889 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 125 candidate_status { last_received { term: 124 index: 14397 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:26.153225 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 125 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:26.153237 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 125 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:26.153364 13588 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 125 FOLLOWER]: Leader election lost for term 125. Reason: could not achieve majority
I20260615 08:08:26.153365 13654 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 125 FOLLOWER]: Leader election lost for term 125. Reason: could not achieve majority
I20260615 08:08:26.153828 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 125 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 124. Current term is 125. Ops: []
I20260615 08:08:26.154099 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 124.14397, Next index: 14398, Last known committed idx: 14397, Time since last communication: 0.000s
I20260615 08:08:26.154229 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 125 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 124. Current term is 125. Ops: []
I20260615 08:08:26.154419 13584 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 124.14397, Next index: 14398, Last known committed idx: 14397, Time since last communication: 0.000s
I20260615 08:08:26.186374 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 125 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:26.186476 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 125 FOLLOWER]: Advancing to term 126
I20260615 08:08:26.187381 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 126 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.187554 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 126 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:26.187868 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 126 candidate_status { last_received { term: 124 index: 14397 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:26.187871 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 126 candidate_status { last_received { term: 124 index: 14397 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:26.187973 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 125 FOLLOWER]: Advancing to term 126
I20260615 08:08:26.188520 13401 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 126 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 126.
I20260615 08:08:26.188755 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 126 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters: d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:26.188905 13588 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 126 FOLLOWER]: Leader election won for term 126
I20260615 08:08:26.188967 13588 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 126 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:26.189023 13588 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14397, Committed index: 14397, Last appended: 124.14397, Last appended by leader: 14397, Current term: 126, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.189441 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 126 LEADER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 124. Current term is 126. Ops: []
I20260615 08:08:26.189477 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 124 to 126, leader changed from d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194) to 666bbeda390e4798abb1630585e244a1 (127.4.42.193). New cstate: current_term: 126 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:26.189635 13584 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 124.14397, Next index: 14398, Last known committed idx: 14397, Time since last communication: 0.000s
I20260615 08:08:26.189719 13584 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer 666bbeda390e4798abb1630585e244a1 log is divergent from this leader: its last log entry 126.14398 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14397
I20260615 08:08:26.190915 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 126 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 124. Current term is 126. Ops: []
I20260615 08:08:26.191097 13522 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 124.14397, Next index: 14398, Last known committed idx: 14397, Time since last communication: 0.000s
I20260615 08:08:26.213630 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 126 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 124 index: 14397. Preceding OpId from leader: term: 126 index: 14398. (index mismatch)
I20260615 08:08:26.213893 13588 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14398, Last known committed idx: 14397, Time since last communication: 0.000s
I20260615 08:08:26.215559 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 126 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 124. Current term is 126. Ops: []
I20260615 08:08:26.215765 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 124.14397, Next index: 14398, Last known committed idx: 14398, Time since last communication: 0.000s
I20260615 08:08:26.219893 13326 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 124 LEADER]: Stepping down as leader of term 124
I20260615 08:08:26.219954 13326 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 124 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:26.220022 13326 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14397, Committed index: 14397, Last appended: 124.14397, Last appended by leader: 14397, Current term: 124, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.220118 13326 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 124 FOLLOWER]: Advancing to term 126
I20260615 08:08:26.220742 13326 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 126 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 124 index: 14397. Preceding OpId from leader: term: 126 index: 14398. (index mismatch)
I20260615 08:08:26.221045 13588 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14398, Last known committed idx: 14397, Time since last communication: 0.000s
I20260615 08:08:26.269636 13654 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 126 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:26.269739 13654 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 126 FOLLOWER]: Advancing to term 127
I20260615 08:08:26.270376 13654 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 127 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.270569 13654 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 127 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:26.270741 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 127 candidate_status { last_received { term: 126 index: 14398 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:26.270921 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 127 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 126. Current term is 127. Ops: []
I20260615 08:08:26.270902 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 127 candidate_status { last_received { term: 126 index: 14398 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:26.271116 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 127 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:26.271149 13588 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 126.14398, Next index: 14399, Last known committed idx: 14398, Time since last communication: 0.000s
I20260615 08:08:26.271214 13654 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 127 FOLLOWER]: Leader election lost for term 127. Reason: could not achieve majority
I20260615 08:08:26.279568 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 126 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:26.279639 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 126 FOLLOWER]: Advancing to term 127
I20260615 08:08:26.280488 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 127 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.280655 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 127 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:26.280794 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 127 candidate_status { last_received { term: 126 index: 14398 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:26.280787 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 127 candidate_status { last_received { term: 126 index: 14398 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:26.280946 13401 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 127 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f in current term 127: Already voted for candidate b97b73a5f2ad444eb230680e3c3fcb6c in this term.
I20260615 08:08:26.281107 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 127 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:26.281229 13522 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 127 FOLLOWER]: Leader election lost for term 127. Reason: could not achieve majority
I20260615 08:08:26.281299 13326 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 127 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 126. Current term is 127. Ops: []
I20260615 08:08:26.281600 13588 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 126.14398, Next index: 14399, Last known committed idx: 14398, Time since last communication: 0.000s
I20260615 08:08:26.303539 13654 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 127 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:26.303632 13654 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 127 FOLLOWER]: Advancing to term 128
I20260615 08:08:26.304230 13654 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 128 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.304414 13654 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 128 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:26.304587 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 128 candidate_status { last_received { term: 126 index: 14398 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:26.304587 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 128 candidate_status { last_received { term: 126 index: 14398 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:26.304728 13326 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 127 FOLLOWER]: Advancing to term 128
I20260615 08:08:26.305307 13326 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 128 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 128.
I20260615 08:08:26.305508 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 128 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1
I20260615 08:08:26.305627 13654 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 128 FOLLOWER]: Leader election won for term 128
I20260615 08:08:26.305779 13654 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 128 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:26.305836 13654 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14398, Committed index: 14398, Last appended: 126.14398, Last appended by leader: 14398, Current term: 128, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.306226 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 128 LEADER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 126. Current term is 128. Ops: []
I20260615 08:08:26.306277 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 126 to 128, leader changed from 666bbeda390e4798abb1630585e244a1 (127.4.42.193) to b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195). New cstate: current_term: 128 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:26.306429 13497 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 126.14398, Next index: 14399, Last known committed idx: 14398, Time since last communication: 0.000s
I20260615 08:08:26.306524 13497 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer b97b73a5f2ad444eb230680e3c3fcb6c log is divergent from this leader: its last log entry 128.14399 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14398
I20260615 08:08:26.316008 13326 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 128 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 126. Current term is 128. Ops: []
I20260615 08:08:26.316094 13588 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 126 LEADER]: Stepping down as leader of term 126
I20260615 08:08:26.316172 13588 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 126 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:26.316253 13588 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14398, Committed index: 14398, Last appended: 126.14398, Last appended by leader: 14398, Current term: 126, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.316359 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 126 FOLLOWER]: Advancing to term 127
W20260615 08:08:26.316354 13468 consensus_queue.cc:1175] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" responder_term: 128 status { last_received { term: 126 index: 14398 } last_committed_idx: 14398 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 126. Current term is 128. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260615 08:08:26.331859 13326 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 128 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 126 index: 14398. Preceding OpId from leader: term: 128 index: 14399. (index mismatch)
I20260615 08:08:26.332152 13654 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14399, Last known committed idx: 14398, Time since last communication: 0.000s
I20260615 08:08:26.334818 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 127 FOLLOWER]: Advancing to term 128
I20260615 08:08:26.335410 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 128 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 126 index: 14398. Preceding OpId from leader: term: 128 index: 14399. (index mismatch)
I20260615 08:08:26.335642 13654 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14399, Last known committed idx: 14398, Time since last communication: 0.000s
I20260615 08:08:26.363584 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 128 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:26.363668 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 128 FOLLOWER]: Advancing to term 129
I20260615 08:08:26.364522 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 129 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.364651 13326 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 129 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 128. Current term is 129. Ops: []
I20260615 08:08:26.364678 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 129 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:26.364795 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 129 candidate_status { last_received { term: 128 index: 14399 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:26.364845 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 129 candidate_status { last_received { term: 128 index: 14399 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:26.364902 13654 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 128.14399, Next index: 14400, Last known committed idx: 14399, Time since last communication: 0.000s
I20260615 08:08:26.365000 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 129 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:26.365074 13522 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 129 FOLLOWER]: Leader election lost for term 129. Reason: could not achieve majority
I20260615 08:08:26.394436 13497 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 128 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:26.394560 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 128 FOLLOWER]: Advancing to term 129
I20260615 08:08:26.395148 13497 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 129 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.395316 13497 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 129 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:26.395484 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 129 candidate_status { last_received { term: 128 index: 14399 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:26.395499 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 129 candidate_status { last_received { term: 128 index: 14399 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:26.395604 13326 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 129 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 in current term 129: Already voted for candidate d4d7c2ebbf334b19a7f964aab04f280f in this term.
I20260615 08:08:26.395804 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 129 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:26.395928 13497 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 129 FOLLOWER]: Leader election lost for term 129. Reason: could not achieve majority
I20260615 08:08:26.398088 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 129 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 128. Current term is 129. Ops: []
I20260615 08:08:26.398285 13668 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 128.14399, Next index: 14400, Last known committed idx: 14399, Time since last communication: 0.000s
I20260615 08:08:26.400172 13326 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 129 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 128. Current term is 129. Ops: []
I20260615 08:08:26.400439 13654 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 128.14399, Next index: 14400, Last known committed idx: 14399, Time since last communication: 0.000s
I20260615 08:08:26.402448 13669 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 128 LEADER]: Stepping down as leader of term 128
I20260615 08:08:26.402532 13669 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 128 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:26.402594 13669 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14399, Committed index: 14399, Last appended: 128.14399, Last appended by leader: 14399, Current term: 128, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.402729 13669 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 128 FOLLOWER]: Advancing to term 129
I20260615 08:08:26.405512 13584 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 129 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:26.405565 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 129 FOLLOWER]: Advancing to term 130
I20260615 08:08:26.406029 13584 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 130 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.406165 13584 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 130 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:26.406301 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 130 candidate_status { last_received { term: 128 index: 14399 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:26.406308 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 130 candidate_status { last_received { term: 128 index: 14399 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:26.406400 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 129 FOLLOWER]: Advancing to term 130
I20260615 08:08:26.406406 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 129 FOLLOWER]: Advancing to term 130
I20260615 08:08:26.406984 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 130 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 130.
I20260615 08:08:26.406994 13401 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 130 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 130.
I20260615 08:08:26.407202 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 130 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f; no voters:
I20260615 08:08:26.407303 13584 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 130 FOLLOWER]: Leader election won for term 130
I20260615 08:08:26.407359 13584 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 130 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:26.407402 13584 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14399, Committed index: 14399, Last appended: 128.14399, Last appended by leader: 14399, Current term: 130, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.407784 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 128 to 130, leader changed from b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195) to d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194). New cstate: current_term: 130 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:26.436262 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 130 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 128 index: 14399. Preceding OpId from leader: term: 130 index: 14400. (index mismatch)
I20260615 08:08:26.436517 13584 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14400, Last known committed idx: 14399, Time since last communication: 0.000s
I20260615 08:08:26.438712 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 130 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 128 index: 14399. Preceding OpId from leader: term: 130 index: 14400. (index mismatch)
I20260615 08:08:26.438918 13584 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14400, Last known committed idx: 14399, Time since last communication: 0.000s
I20260615 08:08:26.492945 13669 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 130 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:26.493052 13669 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 130 FOLLOWER]: Advancing to term 131
I20260615 08:08:26.493752 13669 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 131 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.493944 13669 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 131 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:26.494124 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 131 candidate_status { last_received { term: 130 index: 14400 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:26.494134 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 131 candidate_status { last_received { term: 130 index: 14400 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:26.494442 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 131 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:26.494446 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 131 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 130. Current term is 131. Ops: []
I20260615 08:08:26.494606 13669 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 131 FOLLOWER]: Leader election lost for term 131. Reason: could not achieve majority
I20260615 08:08:26.494729 13584 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 130.14400, Next index: 14401, Last known committed idx: 14400, Time since last communication: 0.000s
I20260615 08:08:26.522673 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 131 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 130. Current term is 131. Ops: []
I20260615 08:08:26.522909 13584 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 130.14400, Next index: 14401, Last known committed idx: 14400, Time since last communication: 0.000s
I20260615 08:08:26.527974 13522 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 130 LEADER]: Stepping down as leader of term 130
I20260615 08:08:26.528028 13522 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 130 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:26.528077 13522 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14400, Committed index: 14400, Last appended: 130.14400, Last appended by leader: 14400, Current term: 130, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.528216 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 130 FOLLOWER]: Advancing to term 131
I20260615 08:08:26.538991 13669 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 131 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:26.539045 13669 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 131 FOLLOWER]: Advancing to term 132
I20260615 08:08:26.539631 13669 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 132 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.539780 13669 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 132 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:26.539945 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 132 candidate_status { last_received { term: 130 index: 14400 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:26.539991 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 132 candidate_status { last_received { term: 130 index: 14400 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:26.540092 13326 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 131 FOLLOWER]: Advancing to term 132
I20260615 08:08:26.540663 13326 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 132 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 132.
I20260615 08:08:26.540874 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 132 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1
I20260615 08:08:26.540977 13669 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 132 FOLLOWER]: Leader election won for term 132
I20260615 08:08:26.541054 13669 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 132 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:26.541085 13669 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14400, Committed index: 14400, Last appended: 130.14400, Last appended by leader: 14400, Current term: 132, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.541507 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 130 to 132, leader changed from d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194) to b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195). New cstate: current_term: 132 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:26.554684 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 130 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:26.554736 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 130 FOLLOWER]: Advancing to term 131
I20260615 08:08:26.555263 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 131 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.555416 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 131 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:26.555586 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 131 candidate_status { last_received { term: 130 index: 14400 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:26.555586 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 131 candidate_status { last_received { term: 130 index: 14400 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:26.555725 13326 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 132 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 131. Current term is 132.
I20260615 08:08:26.555889 13215 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 131 election: Vote denied by peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 132 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 131. Current term is 132.
I20260615 08:08:26.555936 13215 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 131 election: Cancelling election due to peer responding with higher term
I20260615 08:08:26.556025 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 131 FOLLOWER]: Advancing to term 132
I20260615 08:08:26.556527 13588 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 132 FOLLOWER]: Leader election lost for term 131. Reason: Vote denied by peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 132 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 131. Current term is 132.
I20260615 08:08:26.568878 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 132 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 130 index: 14400. Preceding OpId from leader: term: 132 index: 14401. (index mismatch)
I20260615 08:08:26.569123 13669 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14401, Last known committed idx: 14400, Time since last communication: 0.000s
I20260615 08:08:26.569535 13326 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 132 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 130 index: 14400. Preceding OpId from leader: term: 132 index: 14401. (index mismatch)
I20260615 08:08:26.569746 13669 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14401, Last known committed idx: 14400, Time since last communication: 0.000s
I20260615 08:08:26.624182 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 132 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:26.624250 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 132 FOLLOWER]: Advancing to term 133
I20260615 08:08:26.625057 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 133 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.625187 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 133 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:26.625358 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 133 candidate_status { last_received { term: 132 index: 14401 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:26.625366 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 133 candidate_status { last_received { term: 132 index: 14401 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:26.625608 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 133 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:26.625694 13522 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 133 FOLLOWER]: Leader election lost for term 133. Reason: could not achieve majority
I20260615 08:08:26.625981 13326 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 133 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 132. Current term is 133. Ops: []
I20260615 08:08:26.626183 13654 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 132.14401, Next index: 14402, Last known committed idx: 14401, Time since last communication: 0.000s
I20260615 08:08:26.649327 13326 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 133 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 132. Current term is 133. Ops: []
I20260615 08:08:26.649349 13654 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 132 LEADER]: Stepping down as leader of term 132
I20260615 08:08:26.649422 13654 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 132 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:26.649501 13654 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14401, Committed index: 14401, Last appended: 132.14401, Last appended by leader: 14401, Current term: 132, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.649576 13654 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 132 FOLLOWER]: Advancing to term 133
I20260615 08:08:26.653292 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 132 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:26.653362 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 132 FOLLOWER]: Advancing to term 133
I20260615 08:08:26.653900 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 133 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.654081 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 133 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:26.654219 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 133 candidate_status { last_received { term: 132 index: 14401 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:26.654219 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 133 candidate_status { last_received { term: 132 index: 14401 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:26.654323 13326 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 133 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 in current term 133: Already voted for candidate d4d7c2ebbf334b19a7f964aab04f280f in this term.
I20260615 08:08:26.654850 13401 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 133 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 133.
I20260615 08:08:26.655015 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 133 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters:
I20260615 08:08:26.655118 13588 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 133 FOLLOWER]: Leader election won for term 133
I20260615 08:08:26.655174 13588 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 133 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:26.655259 13588 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14401, Committed index: 14401, Last appended: 132.14401, Last appended by leader: 14401, Current term: 133, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.655634 13146 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 132 to 133, leader changed from b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195) to 666bbeda390e4798abb1630585e244a1 (127.4.42.193). New cstate: current_term: 133 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:26.668004 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 133 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:26.668082 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 133 FOLLOWER]: Advancing to term 134
I20260615 08:08:26.668668 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 134 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.668802 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 134 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:26.668988 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 134 candidate_status { last_received { term: 132 index: 14401 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:26.669016 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 134 candidate_status { last_received { term: 132 index: 14401 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:26.669152 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 133 FOLLOWER]: Advancing to term 134
I20260615 08:08:26.669698 13401 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 134 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 134.
I20260615 08:08:26.669870 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 134 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1
I20260615 08:08:26.670007 13522 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 134 FOLLOWER]: Leader election won for term 134
I20260615 08:08:26.670075 13522 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 134 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:26.670120 13522 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14401, Committed index: 14401, Last appended: 132.14401, Last appended by leader: 14401, Current term: 134, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.677409 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 133 to 134, leader changed from 666bbeda390e4798abb1630585e244a1 (127.4.42.193) to d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194). New cstate: current_term: 134 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:26.679910 13326 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 134 LEADER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 133. Current term is 134. Ops: []
I20260615 08:08:26.680114 13588 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14402, Last known committed idx: 14401, Time since last communication: 0.000s
I20260615 08:08:26.680198 13588 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer d4d7c2ebbf334b19a7f964aab04f280f log is divergent from this leader: its last log entry 134.14402 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14401
I20260615 08:08:26.688920 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 134 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 133. Current term is 134. Ops: []
I20260615 08:08:26.689144 13497 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14402, Last known committed idx: 14401, Time since last communication: 0.000s
I20260615 08:08:26.696715 13250 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 133 LEADER]: Stepping down as leader of term 133
I20260615 08:08:26.696750 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 134 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 132 index: 14401. Preceding OpId from leader: term: 134 index: 14402. (index mismatch)
I20260615 08:08:26.696800 13250 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 133 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:26.696863 13250 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14401, Committed index: 14401, Last appended: 133.14402, Last appended by leader: 14402, Current term: 133, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.696945 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 133 FOLLOWER]: Advancing to term 134
I20260615 08:08:26.696970 13580 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14402, Last known committed idx: 14401, Time since last communication: 0.000s
I20260615 08:08:26.697734 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 134 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 133 index: 14402. Preceding OpId from leader: term: 134 index: 14402. (term mismatch)
I20260615 08:08:26.697779 13250 pending_rounds.cc:85] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1: Aborting all ops after (but not including) 14401
I20260615 08:08:26.697799 13250 pending_rounds.cc:107] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1: Aborting uncommitted NO_OP operation due to leader change: 133.14402
I20260615 08:08:26.697826 13250 raft_consensus.cc:2889] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 134 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260615 08:08:26.697969 13580 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14402, Last known committed idx: 14401, Time since last communication: 0.000s
I20260615 08:08:26.728612 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 134 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:26.728696 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 134 FOLLOWER]: Advancing to term 135
I20260615 08:08:26.729422 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 135 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.729542 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 135 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 134. Current term is 135. Ops: []
I20260615 08:08:26.729600 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 135 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:26.729770 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 135 candidate_status { last_received { term: 134 index: 14402 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:26.729797 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 135 candidate_status { last_received { term: 134 index: 14402 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:26.729907 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 134.14402, Next index: 14403, Last known committed idx: 14402, Time since last communication: 0.000s
I20260615 08:08:26.730077 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 135 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:26.730187 13588 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 135 FOLLOWER]: Leader election lost for term 135. Reason: could not achieve majority
I20260615 08:08:26.752425 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 135 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 134. Current term is 135. Ops: []
I20260615 08:08:26.752651 13522 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 134.14402, Next index: 14403, Last known committed idx: 14402, Time since last communication: 0.000s
I20260615 08:08:26.757396 13654 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 134 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:26.757457 13654 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 134 FOLLOWER]: Advancing to term 135
I20260615 08:08:26.758002 13654 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 135 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.758139 13654 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 135 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:26.758284 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 135 candidate_status { last_received { term: 134 index: 14402 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:26.758374 13250 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 135 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c in current term 135: Already voted for candidate 666bbeda390e4798abb1630585e244a1 in this term.
I20260615 08:08:26.758352 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 135 candidate_status { last_received { term: 134 index: 14402 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:26.758574 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 135 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:26.758690 13654 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 135 FOLLOWER]: Leader election lost for term 135. Reason: could not achieve majority
I20260615 08:08:26.763226 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 135 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 134. Current term is 135. Ops: []
I20260615 08:08:26.763412 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 134.14402, Next index: 14403, Last known committed idx: 14402, Time since last communication: 0.000s
I20260615 08:08:26.764526 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 135 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:26.764571 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 135 FOLLOWER]: Advancing to term 136
I20260615 08:08:26.765129 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 136 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.765275 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 136 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:26.765401 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 136 candidate_status { last_received { term: 134 index: 14402 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:26.765401 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 136 candidate_status { last_received { term: 134 index: 14402 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:26.765487 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 135 FOLLOWER]: Advancing to term 136
I20260615 08:08:26.765985 13401 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 136 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 136.
I20260615 08:08:26.766165 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 136 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters: d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:26.766264 13588 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 136 FOLLOWER]: Leader election won for term 136
I20260615 08:08:26.766340 13588 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 136 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:26.766394 13588 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14402, Committed index: 14402, Last appended: 134.14402, Last appended by leader: 14402, Current term: 136, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.766858 13146 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 134 to 136, leader changed from d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194) to 666bbeda390e4798abb1630585e244a1 (127.4.42.193). New cstate: current_term: 136 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:26.776870 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 136 LEADER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 134. Current term is 136. Ops: []
I20260615 08:08:26.777099 13584 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 134.14402, Next index: 14403, Last known committed idx: 14402, Time since last communication: 0.000s
I20260615 08:08:26.777186 13584 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer 666bbeda390e4798abb1630585e244a1 log is divergent from this leader: its last log entry 136.14403 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14402
I20260615 08:08:26.789991 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 136 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 134 index: 14402. Preceding OpId from leader: term: 136 index: 14403. (index mismatch)
I20260615 08:08:26.790210 13588 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14403, Last known committed idx: 14402, Time since last communication: 0.000s
I20260615 08:08:26.791153 13522 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 134 LEADER]: Stepping down as leader of term 134
I20260615 08:08:26.791206 13522 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 134 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:26.791253 13522 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14402, Committed index: 14402, Last appended: 134.14402, Last appended by leader: 14402, Current term: 134, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.791333 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 134 FOLLOWER]: Advancing to term 135
I20260615 08:08:26.791980 13326 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 135 FOLLOWER]: Advancing to term 136
I20260615 08:08:26.792605 13326 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 136 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 134 index: 14402. Preceding OpId from leader: term: 136 index: 14403. (index mismatch)
I20260615 08:08:26.792845 13588 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14403, Last known committed idx: 14402, Time since last communication: 0.000s
I20260615 08:08:26.821691 13654 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 136 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:26.821779 13654 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 136 FOLLOWER]: Advancing to term 137
I20260615 08:08:26.822290 13654 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 137 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.822479 13654 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 137 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:26.822609 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 137 candidate_status { last_received { term: 136 index: 14403 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:26.822616 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 137 candidate_status { last_received { term: 136 index: 14403 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:26.822866 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 137 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:26.822943 13654 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 137 FOLLOWER]: Leader election lost for term 137. Reason: could not achieve majority
I20260615 08:08:26.827258 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 137 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 136. Current term is 137. Ops: []
I20260615 08:08:26.827441 13468 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 136.14403, Next index: 14404, Last known committed idx: 14403, Time since last communication: 0.000s
I20260615 08:08:26.853881 13580 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 136 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:26.853958 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 136 FOLLOWER]: Advancing to term 137
I20260615 08:08:26.854533 13580 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 137 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.854677 13580 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 137 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:26.854825 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 137 candidate_status { last_received { term: 136 index: 14403 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:26.854851 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 137 candidate_status { last_received { term: 136 index: 14403 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:26.854950 13401 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 137 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f in current term 137: Already voted for candidate b97b73a5f2ad444eb230680e3c3fcb6c in this term.
I20260615 08:08:26.855118 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 137 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:26.855233 13580 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 137 FOLLOWER]: Leader election lost for term 137. Reason: could not achieve majority
I20260615 08:08:26.858342 13326 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 137 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 136. Current term is 137. Ops: []
I20260615 08:08:26.858573 13588 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 136.14403, Next index: 14404, Last known committed idx: 14403, Time since last communication: 0.000s
I20260615 08:08:26.860533 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 137 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 136. Current term is 137. Ops: []
I20260615 08:08:26.860731 13497 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 136.14403, Next index: 14404, Last known committed idx: 14403, Time since last communication: 0.000s
I20260615 08:08:26.866305 13654 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 137 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:26.866366 13654 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 137 FOLLOWER]: Advancing to term 138
I20260615 08:08:26.866938 13654 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 138 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.867074 13654 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 138 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:26.867205 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 138 candidate_status { last_received { term: 136 index: 14403 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:26.867291 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 138 candidate_status { last_received { term: 136 index: 14403 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:26.867374 13326 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 137 FOLLOWER]: Advancing to term 138
I20260615 08:08:26.867609 13468 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 136 LEADER]: Stepping down as leader of term 136
I20260615 08:08:26.867648 13468 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 136 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:26.867712 13468 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14403, Committed index: 14403, Last appended: 136.14403, Last appended by leader: 14403, Current term: 136, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.867794 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 136 FOLLOWER]: Advancing to term 137
I20260615 08:08:26.868052 13326 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 138 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 138.
I20260615 08:08:26.868263 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 138 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1
I20260615 08:08:26.868353 13654 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 138 FOLLOWER]: Leader election won for term 138
I20260615 08:08:26.868405 13654 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 138 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:26.868448 13654 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14403, Committed index: 14403, Last appended: 136.14403, Last appended by leader: 14403, Current term: 138, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.868906 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 136 to 138, leader changed from 666bbeda390e4798abb1630585e244a1 (127.4.42.193) to b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195). New cstate: current_term: 138 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
W20260615 08:08:26.871138 13459 lock_manager.cc:494] Txn 7 has not acquired the partition lock after 1000ms
I20260615 08:08:26.871260 13459 mvcc.cc:204] Tried to move back new op lower bound from 7297068670301872128 to 7297068670201417728. Current Snapshot: MvccSnapshot[applied={T|T < 7297068646610063360 or (T in {7297068647657852928,7297068648100282368,7297068649061855232})}]
I20260615 08:08:26.892160 13326 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 138 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 136 index: 14403. Preceding OpId from leader: term: 138 index: 14404. (index mismatch)
I20260615 08:08:26.892467 13654 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14404, Last known committed idx: 14403, Time since last communication: 0.000s
I20260615 08:08:26.894086 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 137 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:26.894178 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 137 FOLLOWER]: Advancing to term 138
I20260615 08:08:26.894899 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 138 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.895077 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 138 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:26.895224 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 138 candidate_status { last_received { term: 136 index: 14403 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:26.895226 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 138 candidate_status { last_received { term: 136 index: 14403 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:26.895467 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 138 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:26.895556 13588 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 138 FOLLOWER]: Leader election lost for term 138. Reason: could not achieve majority
I20260615 08:08:26.905177 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 138 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 136 index: 14403. Preceding OpId from leader: term: 138 index: 14404. (index mismatch)
I20260615 08:08:26.905490 13654 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14404, Last known committed idx: 14403, Time since last communication: 0.000s
I20260615 08:08:26.978678 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 138 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:26.978758 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 138 FOLLOWER]: Advancing to term 139
I20260615 08:08:26.979458 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 139 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:26.979686 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 139 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:26.979786 13326 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 139 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 138. Current term is 139. Ops: []
I20260615 08:08:26.979823 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 139 candidate_status { last_received { term: 138 index: 14404 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:26.979825 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 139 candidate_status { last_received { term: 138 index: 14404 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:26.980196 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 139 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:26.980183 13668 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 138.14404, Next index: 14405, Last known committed idx: 14404, Time since last communication: 0.000s
I20260615 08:08:26.980334 13522 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 139 FOLLOWER]: Leader election lost for term 139. Reason: could not achieve majority
I20260615 08:08:27.009912 13326 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 139 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 138. Current term is 139. Ops: []
I20260615 08:08:27.010207 13669 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 138.14404, Next index: 14405, Last known committed idx: 14404, Time since last communication: 0.000s
I20260615 08:08:27.015434 13668 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 138 LEADER]: Stepping down as leader of term 138
I20260615 08:08:27.015491 13668 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 138 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:27.015555 13668 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14404, Committed index: 14404, Last appended: 138.14404, Last appended by leader: 14404, Current term: 138, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.015681 13668 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 138 FOLLOWER]: Advancing to term 139
I20260615 08:08:27.020258 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 139 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:27.020324 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 139 FOLLOWER]: Advancing to term 140
I20260615 08:08:27.020723 13468 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 138 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:27.020797 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 138 FOLLOWER]: Advancing to term 139
I20260615 08:08:27.021152 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 140 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.021297 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 140 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:27.021418 13468 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 139 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.021505 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 140 candidate_status { last_received { term: 138 index: 14404 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:27.021556 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 139 FOLLOWER]: Advancing to term 140
I20260615 08:08:27.021561 13468 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 139 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:27.021858 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 140 candidate_status { last_received { term: 138 index: 14404 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:27.021919 13400 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 139 FOLLOWER]: Advancing to term 140
I20260615 08:08:27.021864 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 139 candidate_status { last_received { term: 138 index: 14404 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:27.022238 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 140 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 140.
I20260615 08:08:27.022408 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 140 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters:
I20260615 08:08:27.022441 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 139 candidate_status { last_received { term: 138 index: 14404 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:27.022517 13522 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 140 FOLLOWER]: Leader election won for term 140
I20260615 08:08:27.022575 13522 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 140 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:27.022589 13400 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 140 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 140.
I20260615 08:08:27.022620 13522 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14404, Committed index: 14404, Last appended: 138.14404, Last appended by leader: 14404, Current term: 140, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.022989 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 139 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:27.023036 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 138 to 140, leader changed from b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195) to d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194). New cstate: current_term: 140 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:27.023083 13468 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 140 FOLLOWER]: Leader election lost for term 139. Reason: could not achieve majority
I20260615 08:08:27.056473 13468 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 140 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:27.056573 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 140 FOLLOWER]: Advancing to term 141
I20260615 08:08:27.057268 13468 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 141 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.057443 13468 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 141 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:27.057552 13400 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 140 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 138 index: 14404. Preceding OpId from leader: term: 140 index: 14405. (index mismatch)
I20260615 08:08:27.057626 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 141 candidate_status { last_received { term: 138 index: 14404 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:27.057651 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 141 candidate_status { last_received { term: 138 index: 14404 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:27.057713 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 140 FOLLOWER]: Advancing to term 141
I20260615 08:08:27.058255 13401 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 141 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 141.
I20260615 08:08:27.058452 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 141 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters: d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:27.058503 13522 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14405, Last known committed idx: 14404, Time since last communication: 0.000s
I20260615 08:08:27.058583 13468 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 141 FOLLOWER]: Leader election won for term 141
I20260615 08:08:27.058627 13468 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 141 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:27.058674 13468 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14404, Committed index: 14404, Last appended: 138.14404, Last appended by leader: 14404, Current term: 141, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.058881 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 141 LEADER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 140. Current term is 141. Ops: []
I20260615 08:08:27.058964 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 141 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 140. Current term is 141. Ops: [140.14405-140.14405]
I20260615 08:08:27.059068 13522 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14405, Last known committed idx: 14404, Time since last communication: 0.000s
I20260615 08:08:27.059154 13522 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer 666bbeda390e4798abb1630585e244a1 log is divergent from this leader: its last log entry 141.14405 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14404
I20260615 08:08:27.059098 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 140 to 141, leader changed from d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194) to 666bbeda390e4798abb1630585e244a1 (127.4.42.193). New cstate: current_term: 141 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:27.059417 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 138.14404, Next index: 14405, Last known committed idx: 14404, Time since last communication: 0.000s
I20260615 08:08:27.067283 13522 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 140 LEADER]: Stepping down as leader of term 140
I20260615 08:08:27.067342 13522 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 140 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:27.067399 13522 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14404, Committed index: 14404, Last appended: 140.14405, Last appended by leader: 14405, Current term: 140, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.067479 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 140 FOLLOWER]: Advancing to term 141
I20260615 08:08:27.087405 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 141 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 138 index: 14404. Preceding OpId from leader: term: 141 index: 14405. (index mismatch)
I20260615 08:08:27.087671 13468 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14405, Last known committed idx: 14404, Time since last communication: 0.000s
I20260615 08:08:27.089694 13326 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 141 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 140 index: 14405. Preceding OpId from leader: term: 141 index: 14405. (term mismatch)
I20260615 08:08:27.089730 13326 pending_rounds.cc:85] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f: Aborting all ops after (but not including) 14404
I20260615 08:08:27.089742 13326 pending_rounds.cc:107] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f: Aborting uncommitted NO_OP operation due to leader change: 140.14405
I20260615 08:08:27.089754 13326 raft_consensus.cc:2889] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 141 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260615 08:08:27.089916 13497 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14405, Last known committed idx: 14404, Time since last communication: 0.000s
I20260615 08:08:27.120796 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 141 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:27.120875 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 141 FOLLOWER]: Advancing to term 142
I20260615 08:08:27.121425 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 142 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.121577 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 142 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:27.121783 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 142 candidate_status { last_received { term: 141 index: 14405 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:27.121796 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 142 candidate_status { last_received { term: 141 index: 14405 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:27.122051 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 142 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:27.122138 13522 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 142 FOLLOWER]: Leader election lost for term 142. Reason: could not achieve majority
I20260615 08:08:27.123922 13326 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 142 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 141. Current term is 142. Ops: []
I20260615 08:08:27.124172 13588 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 141.14405, Next index: 14406, Last known committed idx: 14405, Time since last communication: 0.000s
I20260615 08:08:27.145431 13668 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 141 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:27.145491 13668 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 141 FOLLOWER]: Advancing to term 142
I20260615 08:08:27.146078 13668 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 142 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.146270 13668 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 142 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:27.146407 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 142 candidate_status { last_received { term: 141 index: 14405 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:27.146459 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 142 candidate_status { last_received { term: 141 index: 14405 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:27.146703 13326 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 142 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c in current term 142: Already voted for candidate d4d7c2ebbf334b19a7f964aab04f280f in this term.
I20260615 08:08:27.146868 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 142 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:27.146978 13668 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 142 FOLLOWER]: Leader election lost for term 142. Reason: could not achieve majority
I20260615 08:08:27.149390 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 142 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 141. Current term is 142. Ops: []
I20260615 08:08:27.149643 13468 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 141.14405, Next index: 14406, Last known committed idx: 14405, Time since last communication: 0.000s
I20260615 08:08:27.154448 13326 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 142 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 141. Current term is 142. Ops: []
I20260615 08:08:27.154712 13468 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 141.14405, Next index: 14406, Last known committed idx: 14405, Time since last communication: 0.000s
I20260615 08:08:27.164479 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 142 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:27.164557 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 142 FOLLOWER]: Advancing to term 143
I20260615 08:08:27.165086 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 143 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.165239 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 143 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:27.165426 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 143 candidate_status { last_received { term: 141 index: 14405 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:27.165453 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 143 candidate_status { last_received { term: 141 index: 14405 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:27.165548 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 142 FOLLOWER]: Advancing to term 143
I20260615 08:08:27.166108 13401 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 143 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 143.
I20260615 08:08:27.166286 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 143 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1
I20260615 08:08:27.166378 13522 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 143 FOLLOWER]: Leader election won for term 143
I20260615 08:08:27.166440 13522 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 143 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:27.166508 13522 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14405, Committed index: 14405, Last appended: 141.14405, Last appended by leader: 14405, Current term: 143, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.166916 13146 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 141 to 143, leader changed from 666bbeda390e4798abb1630585e244a1 (127.4.42.193) to d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194). New cstate: current_term: 143 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:27.177822 13326 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 143 LEADER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 141. Current term is 143. Ops: []
I20260615 08:08:27.178046 13588 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 141.14405, Next index: 14406, Last known committed idx: 14405, Time since last communication: 0.000s
I20260615 08:08:27.178123 13588 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer d4d7c2ebbf334b19a7f964aab04f280f log is divergent from this leader: its last log entry 143.14406 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14405
I20260615 08:08:27.181950 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 143 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 141. Current term is 143. Ops: []
I20260615 08:08:27.182184 13588 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 141.14405, Next index: 14406, Last known committed idx: 14405, Time since last communication: 0.000s
I20260615 08:08:27.186043 13497 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 141 LEADER]: Stepping down as leader of term 141
I20260615 08:08:27.186092 13497 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 141 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:27.186136 13497 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14405, Committed index: 14405, Last appended: 141.14405, Last appended by leader: 14405, Current term: 141, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.186240 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 141 FOLLOWER]: Advancing to term 142
I20260615 08:08:27.191063 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 143 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 141 index: 14405. Preceding OpId from leader: term: 143 index: 14406. (index mismatch)
I20260615 08:08:27.191287 13522 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14406, Last known committed idx: 14405, Time since last communication: 0.000s
I20260615 08:08:27.199493 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 142 FOLLOWER]: Advancing to term 143
I20260615 08:08:27.200019 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 143 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 141 index: 14405. Preceding OpId from leader: term: 143 index: 14406. (index mismatch)
I20260615 08:08:27.200227 13522 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14406, Last known committed idx: 14405, Time since last communication: 0.000s
I20260615 08:08:27.222476 13668 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 143 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:27.222548 13668 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 143 FOLLOWER]: Advancing to term 144
I20260615 08:08:27.223022 13668 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 144 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.223191 13668 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 144 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:27.223312 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 144 candidate_status { last_received { term: 143 index: 14406 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:27.223377 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 144 candidate_status { last_received { term: 143 index: 14406 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:27.223552 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 144 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:27.223690 13668 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 144 FOLLOWER]: Leader election lost for term 144. Reason: could not achieve majority
I20260615 08:08:27.226342 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 144 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 143. Current term is 144. Ops: []
I20260615 08:08:27.226563 13522 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 143.14406, Next index: 14407, Last known committed idx: 14406, Time since last communication: 0.000s
I20260615 08:08:27.230629 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 143 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:27.230674 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 143 FOLLOWER]: Advancing to term 144
I20260615 08:08:27.231117 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 144 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.231245 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 144 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:27.231391 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 144 candidate_status { last_received { term: 143 index: 14406 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:27.231391 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 144 candidate_status { last_received { term: 143 index: 14406 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:27.231482 13401 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 144 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 in current term 144: Already voted for candidate b97b73a5f2ad444eb230680e3c3fcb6c in this term.
I20260615 08:08:27.231612 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 144 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:27.231715 13588 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 144 FOLLOWER]: Leader election lost for term 144. Reason: could not achieve majority
I20260615 08:08:27.233916 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 144 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 143. Current term is 144. Ops: []
I20260615 08:08:27.234126 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 143.14406, Next index: 14407, Last known committed idx: 14406, Time since last communication: 0.000s
I20260615 08:08:27.253577 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 144 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 143. Current term is 144. Ops: []
I20260615 08:08:27.253818 13522 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 143.14406, Next index: 14407, Last known committed idx: 14406, Time since last communication: 0.000s
I20260615 08:08:27.263101 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 144 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 143. Current term is 144. Ops: []
I20260615 08:08:27.263324 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 143.14406, Next index: 14407, Last known committed idx: 14406, Time since last communication: 0.000s
I20260615 08:08:27.264999 13668 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 144 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:27.265041 13668 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 144 FOLLOWER]: Advancing to term 145
I20260615 08:08:27.265569 13668 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 145 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.265724 13668 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 145 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:27.265826 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 144 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:27.265851 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 145 candidate_status { last_received { term: 143 index: 14406 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:27.265869 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 144 FOLLOWER]: Advancing to term 145
I20260615 08:08:27.265863 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 145 candidate_status { last_received { term: 143 index: 14406 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:27.266546 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 145 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.266674 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 145 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:27.266682 13250 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 145 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c in current term 145: Already voted for candidate 666bbeda390e4798abb1630585e244a1 in this term.
I20260615 08:08:27.266775 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 145 candidate_status { last_received { term: 143 index: 14406 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:27.266820 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 145 candidate_status { last_received { term: 143 index: 14406 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:27.266862 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 145 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:27.266873 13401 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 145 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 in current term 145: Already voted for candidate b97b73a5f2ad444eb230680e3c3fcb6c in this term.
I20260615 08:08:27.266960 13668 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 145 FOLLOWER]: Leader election lost for term 145. Reason: could not achieve majority
I20260615 08:08:27.267071 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 145 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:27.267215 13588 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 145 FOLLOWER]: Leader election lost for term 145. Reason: could not achieve majority
I20260615 08:08:27.285861 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 145 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 143. Current term is 145. Ops: []
I20260615 08:08:27.286109 13522 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 143.14406, Next index: 14407, Last known committed idx: 14406, Time since last communication: 0.000s
I20260615 08:08:27.286391 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 145 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 143. Current term is 145. Ops: []
I20260615 08:08:27.286621 13522 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 143.14406, Next index: 14407, Last known committed idx: 14406, Time since last communication: 0.000s
I20260615 08:08:27.290274 13584 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 143 LEADER]: Stepping down as leader of term 143
I20260615 08:08:27.290311 13584 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 143 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:27.290373 13584 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14406, Committed index: 14406, Last appended: 143.14406, Last appended by leader: 14406, Current term: 143, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.290486 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 143 FOLLOWER]: Advancing to term 144
I20260615 08:08:27.302553 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 145 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:27.302605 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 145 FOLLOWER]: Advancing to term 146
I20260615 08:08:27.303112 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 146 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.303251 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 146 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:27.303452 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 146 candidate_status { last_received { term: 143 index: 14406 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:27.303452 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 146 candidate_status { last_received { term: 143 index: 14406 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:27.303568 13326 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 144 FOLLOWER]: Advancing to term 146
I20260615 08:08:27.303593 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 145 FOLLOWER]: Advancing to term 146
I20260615 08:08:27.304200 13401 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 146 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 146.
I20260615 08:08:27.304200 13326 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 146 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 146.
I20260615 08:08:27.304404 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 146 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters:
I20260615 08:08:27.304517 13588 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 146 FOLLOWER]: Leader election won for term 146
I20260615 08:08:27.304594 13588 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 146 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:27.304648 13588 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14406, Committed index: 14406, Last appended: 143.14406, Last appended by leader: 14406, Current term: 146, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.305060 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 143 to 146, leader changed from d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194) to 666bbeda390e4798abb1630585e244a1 (127.4.42.193). New cstate: current_term: 146 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:27.331255 13326 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 146 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 143 index: 14406. Preceding OpId from leader: term: 146 index: 14407. (index mismatch)
I20260615 08:08:27.331544 13588 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14407, Last known committed idx: 14406, Time since last communication: 0.000s
I20260615 08:08:27.336254 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 146 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 143 index: 14406. Preceding OpId from leader: term: 146 index: 14407. (index mismatch)
I20260615 08:08:27.336489 13588 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14407, Last known committed idx: 14406, Time since last communication: 0.000s
W20260615 08:08:27.346467 13497 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 143 current term: 146 is higher.
I20260615 08:08:27.367734 13668 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 146 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:27.367806 13668 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 146 FOLLOWER]: Advancing to term 147
I20260615 08:08:27.368425 13668 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 147 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.368611 13668 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 147 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:27.368769 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 147 candidate_status { last_received { term: 146 index: 14407 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:27.368808 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 147 candidate_status { last_received { term: 146 index: 14407 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:27.369029 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 147 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:27.369128 13668 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 147 FOLLOWER]: Leader election lost for term 147. Reason: could not achieve majority
I20260615 08:08:27.371930 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 147 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 146. Current term is 147. Ops: []
I20260615 08:08:27.372160 13588 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 146.14407, Next index: 14408, Last known committed idx: 14407, Time since last communication: 0.000s
I20260615 08:08:27.401537 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 147 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 146. Current term is 147. Ops: []
I20260615 08:08:27.401799 13468 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 146.14407, Next index: 14408, Last known committed idx: 14407, Time since last communication: 0.000s
I20260615 08:08:27.407457 13668 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 147 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:27.407532 13668 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 147 FOLLOWER]: Advancing to term 148
I20260615 08:08:27.408133 13668 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 148 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.408306 13668 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 148 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:27.408449 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 148 candidate_status { last_received { term: 146 index: 14407 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:27.408463 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 148 candidate_status { last_received { term: 146 index: 14407 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:27.408705 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 148 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:27.408805 13668 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 148 FOLLOWER]: Leader election lost for term 148. Reason: could not achieve majority
I20260615 08:08:27.415406 13580 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 146 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:27.415477 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 146 FOLLOWER]: Advancing to term 147
I20260615 08:08:27.416020 13580 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 147 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.416179 13580 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 147 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:27.416338 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 147 candidate_status { last_received { term: 146 index: 14407 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:27.416340 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 147 candidate_status { last_received { term: 146 index: 14407 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:27.416531 13401 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 148 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 147. Current term is 148.
I20260615 08:08:27.416664 13289 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 147 election: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 148 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 147. Current term is 148.
I20260615 08:08:27.416711 13289 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 147 election: Cancelling election due to peer responding with higher term
I20260615 08:08:27.416746 13326 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 147 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 146. Current term is 147. Ops: []
I20260615 08:08:27.416798 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 147 FOLLOWER]: Advancing to term 148
I20260615 08:08:27.416929 13497 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 146.14407, Next index: 14408, Last known committed idx: 14407, Time since last communication: 0.000s
I20260615 08:08:27.417375 13580 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 148 FOLLOWER]: Leader election lost for term 147. Reason: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 148 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 147. Current term is 148.
I20260615 08:08:27.421257 13588 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 146 LEADER]: Stepping down as leader of term 146
I20260615 08:08:27.421299 13588 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 146 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:27.421366 13588 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14407, Committed index: 14407, Last appended: 146.14407, Last appended by leader: 14407, Current term: 146, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.421439 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 146 FOLLOWER]: Advancing to term 147
I20260615 08:08:27.439273 13668 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 148 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:27.439333 13668 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 148 FOLLOWER]: Advancing to term 149
I20260615 08:08:27.439872 13668 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 149 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.440011 13668 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 149 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:27.440181 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 149 candidate_status { last_received { term: 146 index: 14407 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:27.440184 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 149 candidate_status { last_received { term: 146 index: 14407 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:27.440260 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 147 FOLLOWER]: Advancing to term 149
I20260615 08:08:27.440274 13326 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 148 FOLLOWER]: Advancing to term 149
I20260615 08:08:27.440742 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 149 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 149.
I20260615 08:08:27.440855 13326 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 149 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 149.
I20260615 08:08:27.440948 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 149 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters:
I20260615 08:08:27.441040 13668 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 149 FOLLOWER]: Leader election won for term 149
I20260615 08:08:27.441087 13668 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 149 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:27.441130 13668 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14407, Committed index: 14407, Last appended: 146.14407, Last appended by leader: 14407, Current term: 149, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.441614 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 146 to 149, leader changed from 666bbeda390e4798abb1630585e244a1 (127.4.42.193) to b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195). New cstate: current_term: 149 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:27.474867 13326 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 149 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 146 index: 14407. Preceding OpId from leader: term: 149 index: 14408. (index mismatch)
I20260615 08:08:27.475180 13668 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14408, Last known committed idx: 14407, Time since last communication: 0.000s
I20260615 08:08:27.477613 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 149 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 146 index: 14407. Preceding OpId from leader: term: 149 index: 14408. (index mismatch)
I20260615 08:08:27.477820 13668 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14408, Last known committed idx: 14407, Time since last communication: 0.000s
I20260615 08:08:27.507165 13584 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 149 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:27.507241 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 149 FOLLOWER]: Advancing to term 150
I20260615 08:08:27.507818 13584 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 150 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.507963 13584 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 150 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:27.508131 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 150 candidate_status { last_received { term: 149 index: 14408 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:27.508174 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 150 candidate_status { last_received { term: 149 index: 14408 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:27.508386 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 150 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:27.508419 13326 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 150 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 149. Current term is 150. Ops: []
I20260615 08:08:27.508496 13584 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 150 FOLLOWER]: Leader election lost for term 150. Reason: could not achieve majority
I20260615 08:08:27.508698 13668 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 149.14408, Next index: 14409, Last known committed idx: 14408, Time since last communication: 0.000s
I20260615 08:08:27.530681 13326 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 150 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 149. Current term is 150. Ops: []
I20260615 08:08:27.530964 13668 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 149.14408, Next index: 14409, Last known committed idx: 14408, Time since last communication: 0.000s
I20260615 08:08:27.539922 13584 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 150 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:27.539978 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 150 FOLLOWER]: Advancing to term 151
I20260615 08:08:27.540551 13584 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 151 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.540689 13584 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 151 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:27.540848 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 151 candidate_status { last_received { term: 149 index: 14408 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:27.540901 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 151 candidate_status { last_received { term: 149 index: 14408 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:27.541095 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 151 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:27.541193 13584 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 151 FOLLOWER]: Leader election lost for term 151. Reason: could not achieve majority
I20260615 08:08:27.559234 13326 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 151 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 149. Current term is 151. Ops: []
I20260615 08:08:27.559473 13669 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 149.14408, Next index: 14409, Last known committed idx: 14408, Time since last communication: 0.000s
I20260615 08:08:27.581539 13654 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 149 LEADER]: Stepping down as leader of term 149
I20260615 08:08:27.581597 13654 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 149 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:27.581676 13654 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14408, Committed index: 14408, Last appended: 149.14408, Last appended by leader: 14408, Current term: 149, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.581761 13654 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 149 FOLLOWER]: Advancing to term 150
I20260615 08:08:27.601841 13584 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 151 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:27.601908 13584 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 151 FOLLOWER]: Advancing to term 152
I20260615 08:08:27.602641 13584 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 152 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.602792 13584 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 152 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:27.602983 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 152 candidate_status { last_received { term: 149 index: 14408 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:27.603034 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 152 candidate_status { last_received { term: 149 index: 14408 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:27.603127 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 150 FOLLOWER]: Advancing to term 152
I20260615 08:08:27.603649 13401 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 152 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 152.
I20260615 08:08:27.603852 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 152 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1
I20260615 08:08:27.603978 13584 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 152 FOLLOWER]: Leader election won for term 152
I20260615 08:08:27.604090 13584 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 152 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:27.604146 13584 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14408, Committed index: 14408, Last appended: 149.14408, Last appended by leader: 14408, Current term: 152, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.604532 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 149 to 152, leader changed from b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195) to d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194). New cstate: current_term: 152 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:27.609716 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 149 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:27.609771 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 149 FOLLOWER]: Advancing to term 150
I20260615 08:08:27.610307 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 150 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.610446 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 150 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:27.610606 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 150 candidate_status { last_received { term: 149 index: 14408 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:27.610613 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 150 candidate_status { last_received { term: 149 index: 14408 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:27.610680 13401 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 152 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 150. Current term is 152.
I20260615 08:08:27.610900 13213 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 150 election: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 152 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 150. Current term is 152.
I20260615 08:08:27.610960 13213 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 150 election: Cancelling election due to peer responding with higher term
I20260615 08:08:27.611017 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 150 FOLLOWER]: Advancing to term 152
I20260615 08:08:27.611526 13588 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 152 FOLLOWER]: Leader election lost for term 150. Reason: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 152 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 150. Current term is 152.
I20260615 08:08:27.629951 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 152 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 149 index: 14408. Preceding OpId from leader: term: 152 index: 14409. (index mismatch)
I20260615 08:08:27.629951 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 152 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 149 index: 14408. Preceding OpId from leader: term: 152 index: 14409. (index mismatch)
I20260615 08:08:27.630239 13584 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14409, Last known committed idx: 14408, Time since last communication: 0.000s
I20260615 08:08:27.630329 13580 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14409, Last known committed idx: 14408, Time since last communication: 0.000s
I20260615 08:08:27.661337 13654 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 152 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:27.661406 13654 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 152 FOLLOWER]: Advancing to term 153
I20260615 08:08:27.662026 13654 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 153 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.662178 13654 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 153 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:27.662322 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 153 candidate_status { last_received { term: 152 index: 14409 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:27.662374 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 153 candidate_status { last_received { term: 152 index: 14409 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:27.662566 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 153 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:27.662654 13654 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 153 FOLLOWER]: Leader election lost for term 153. Reason: could not achieve majority
I20260615 08:08:27.668207 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 153 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 152. Current term is 153. Ops: []
I20260615 08:08:27.668423 13522 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 152.14409, Next index: 14410, Last known committed idx: 14409, Time since last communication: 0.000s
I20260615 08:08:27.688309 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 152 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:27.688371 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 152 FOLLOWER]: Advancing to term 153
I20260615 08:08:27.688925 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 153 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.689076 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 153 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:27.689230 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 153 candidate_status { last_received { term: 152 index: 14409 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:27.689288 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 153 candidate_status { last_received { term: 152 index: 14409 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:27.689363 13401 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 153 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 in current term 153: Already voted for candidate b97b73a5f2ad444eb230680e3c3fcb6c in this term.
I20260615 08:08:27.689502 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 153 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:27.689610 13588 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 153 FOLLOWER]: Leader election lost for term 153. Reason: could not achieve majority
I20260615 08:08:27.691433 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 153 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 152. Current term is 153. Ops: []
I20260615 08:08:27.691668 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 152.14409, Next index: 14410, Last known committed idx: 14409, Time since last communication: 0.000s
I20260615 08:08:27.692201 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 153 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 152. Current term is 153. Ops: []
I20260615 08:08:27.692410 13522 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 152.14409, Next index: 14410, Last known committed idx: 14409, Time since last communication: 0.000s
I20260615 08:08:27.699146 13654 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 153 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:27.699203 13654 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 153 FOLLOWER]: Advancing to term 154
I20260615 08:08:27.699819 13654 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 154 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.699966 13654 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 154 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:27.700145 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 154 candidate_status { last_received { term: 152 index: 14409 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:27.700161 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 154 candidate_status { last_received { term: 152 index: 14409 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:27.700299 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 153 FOLLOWER]: Advancing to term 154
I20260615 08:08:27.700932 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 154 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 154.
I20260615 08:08:27.701123 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 154 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters: d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:27.701248 13654 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 154 FOLLOWER]: Leader election won for term 154
I20260615 08:08:27.701332 13654 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 154 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:27.701387 13654 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14409, Committed index: 14409, Last appended: 152.14409, Last appended by leader: 14409, Current term: 154, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.701849 13146 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 152 to 154, leader changed from d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194) to b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195). New cstate: current_term: 154 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:27.720906 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 154 LEADER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 152. Current term is 154. Ops: []
I20260615 08:08:27.721239 13584 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 152.14409, Next index: 14410, Last known committed idx: 14409, Time since last communication: 0.000s
I20260615 08:08:27.721359 13584 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer b97b73a5f2ad444eb230680e3c3fcb6c log is divergent from this leader: its last log entry 154.14410 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14409
I20260615 08:08:27.725076 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 154 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 152 index: 14409. Preceding OpId from leader: term: 154 index: 14410. (index mismatch)
I20260615 08:08:27.725325 13654 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14410, Last known committed idx: 14409, Time since last communication: 0.000s
I20260615 08:08:27.726225 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 154 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 152. Current term is 154. Ops: []
I20260615 08:08:27.726437 13522 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 152.14409, Next index: 14410, Last known committed idx: 14410, Time since last communication: 0.000s
I20260615 08:08:27.727377 13326 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 152 LEADER]: Stepping down as leader of term 152
I20260615 08:08:27.727432 13326 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 152 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:27.727491 13326 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14409, Committed index: 14409, Last appended: 152.14409, Last appended by leader: 14409, Current term: 152, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.727567 13326 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 152 FOLLOWER]: Advancing to term 154
I20260615 08:08:27.728127 13326 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 154 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 152 index: 14409. Preceding OpId from leader: term: 154 index: 14410. (index mismatch)
I20260615 08:08:27.728340 13668 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14410, Last known committed idx: 14409, Time since last communication: 0.000s
I20260615 08:08:27.756999 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 154 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:27.757097 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 154 FOLLOWER]: Advancing to term 155
I20260615 08:08:27.757710 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 155 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.757898 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 155 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:27.758055 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 155 candidate_status { last_received { term: 154 index: 14410 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:27.758096 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 155 candidate_status { last_received { term: 154 index: 14410 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:27.758315 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 155 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:27.758412 13588 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 155 FOLLOWER]: Leader election lost for term 155. Reason: could not achieve majority
I20260615 08:08:27.762015 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 155 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 154. Current term is 155. Ops: []
I20260615 08:08:27.762257 13668 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 154.14410, Next index: 14411, Last known committed idx: 14410, Time since last communication: 0.000s
I20260615 08:08:27.793262 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 155 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 154. Current term is 155. Ops: []
I20260615 08:08:27.793491 13668 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 154.14410, Next index: 14411, Last known committed idx: 14410, Time since last communication: 0.000s
I20260615 08:08:27.795919 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 155 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:27.795964 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 155 FOLLOWER]: Advancing to term 156
I20260615 08:08:27.796514 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 156 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.796661 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 156 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:27.796805 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 156 candidate_status { last_received { term: 154 index: 14410 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:27.796888 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 156 candidate_status { last_received { term: 154 index: 14410 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:27.797094 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 156 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:27.797194 13588 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 156 FOLLOWER]: Leader election lost for term 156. Reason: could not achieve majority
I20260615 08:08:27.824397 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 156 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 154. Current term is 156. Ops: []
I20260615 08:08:27.824620 13654 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 154.14410, Next index: 14411, Last known committed idx: 14410, Time since last communication: 0.000s
I20260615 08:08:27.840435 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 154 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:27.840517 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 154 FOLLOWER]: Advancing to term 155
I20260615 08:08:27.841136 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 155 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.841245 13326 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 155 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 154. Current term is 155. Ops: []
I20260615 08:08:27.841281 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 155 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:27.841461 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 155 candidate_status { last_received { term: 154 index: 14410 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:27.841470 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 155 candidate_status { last_received { term: 154 index: 14410 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:27.841574 13250 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 156 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 155. Current term is 156.
I20260615 08:08:27.841475 13654 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 154.14410, Next index: 14411, Last known committed idx: 14410, Time since last communication: 0.000s
I20260615 08:08:27.841734 13289 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 155 election: Vote denied by peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 156 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 155. Current term is 156.
I20260615 08:08:27.841797 13289 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 155 election: Cancelling election due to peer responding with higher term
I20260615 08:08:27.841854 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 155 FOLLOWER]: Advancing to term 156
I20260615 08:08:27.842365 13522 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 156 FOLLOWER]: Leader election lost for term 155. Reason: Vote denied by peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 156 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 155. Current term is 156.
I20260615 08:08:27.849702 13668 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 154 LEADER]: Stepping down as leader of term 154
I20260615 08:08:27.849752 13668 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 154 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:27.849825 13668 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14410, Committed index: 14410, Last appended: 154.14410, Last appended by leader: 14410, Current term: 154, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.849907 13668 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 154 FOLLOWER]: Advancing to term 155
I20260615 08:08:27.854874 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 156 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:27.854943 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 156 FOLLOWER]: Advancing to term 157
I20260615 08:08:27.855419 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 157 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.855600 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 157 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:27.855738 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 157 candidate_status { last_received { term: 154 index: 14410 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:27.855738 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 157 candidate_status { last_received { term: 154 index: 14410 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:27.855847 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 155 FOLLOWER]: Advancing to term 157
I20260615 08:08:27.855849 13326 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 156 FOLLOWER]: Advancing to term 157
I20260615 08:08:27.856475 13326 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 157 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 157.
I20260615 08:08:27.856475 13401 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 157 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 157.
I20260615 08:08:27.856809 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 157 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters:
I20260615 08:08:27.856931 13588 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 157 FOLLOWER]: Leader election won for term 157
I20260615 08:08:27.857028 13588 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 157 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:27.857087 13588 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14410, Committed index: 14410, Last appended: 154.14410, Last appended by leader: 14410, Current term: 157, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.857527 13146 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 154 to 157, leader changed from b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195) to 666bbeda390e4798abb1630585e244a1 (127.4.42.193). New cstate: current_term: 157 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
W20260615 08:08:27.872181 13460 lock_manager.cc:494] Txn 7 has not acquired the partition lock after 1000ms
I20260615 08:08:27.873165 13326 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 157 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 154 index: 14410. Preceding OpId from leader: term: 157 index: 14412. (index mismatch)
I20260615 08:08:27.873143 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 157 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 154 index: 14410. Preceding OpId from leader: term: 157 index: 14412. (index mismatch)
I20260615 08:08:27.873425 13588 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14411, Last known committed idx: 14410, Time since last communication: 0.000s
I20260615 08:08:27.873515 13468 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14411, Last known committed idx: 14410, Time since last communication: 0.000s
I20260615 08:08:27.928459 13654 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 157 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:27.928550 13654 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 157 FOLLOWER]: Advancing to term 158
I20260615 08:08:27.929162 13654 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 158 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.929352 13654 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 158 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:27.929535 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 158 candidate_status { last_received { term: 157 index: 14412 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:27.929535 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 158 candidate_status { last_received { term: 157 index: 14412 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:27.929788 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 158 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:27.929904 13654 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 158 FOLLOWER]: Leader election lost for term 158. Reason: could not achieve majority
I20260615 08:08:27.932523 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 158 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 157. Current term is 158. Ops: []
I20260615 08:08:27.932724 13588 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 157.14412, Next index: 14413, Last known committed idx: 14412, Time since last communication: 0.000s
I20260615 08:08:27.964253 13668 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 158 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:27.964330 13668 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 158 FOLLOWER]: Advancing to term 159
I20260615 08:08:27.964891 13668 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 159 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.965066 13668 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 159 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:27.965219 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 159 candidate_status { last_received { term: 157 index: 14412 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:27.965308 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 159 candidate_status { last_received { term: 157 index: 14412 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:27.965504 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 159 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:27.965610 13668 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 159 FOLLOWER]: Leader election lost for term 159. Reason: could not achieve majority
I20260615 08:08:27.967204 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 159 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 157. Current term is 159. Ops: []
I20260615 08:08:27.967399 13588 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 157.14412, Next index: 14413, Last known committed idx: 14412, Time since last communication: 0.000s
I20260615 08:08:27.982693 13497 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 157 LEADER]: Stepping down as leader of term 157
I20260615 08:08:27.982748 13497 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 157 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:27.982793 13497 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14412, Committed index: 14412, Last appended: 157.14412, Last appended by leader: 14412, Current term: 157, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:27.982910 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 157 FOLLOWER]: Advancing to term 158
I20260615 08:08:28.008126 13497 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 158 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:28.008198 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 158 FOLLOWER]: Advancing to term 159
I20260615 08:08:28.008805 13497 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 159 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.008962 13497 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 159 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:28.009155 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 159 candidate_status { last_received { term: 157 index: 14412 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:28.009166 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 159 candidate_status { last_received { term: 157 index: 14412 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:28.009289 13401 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 159 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 in current term 159: Already voted for candidate b97b73a5f2ad444eb230680e3c3fcb6c in this term.
I20260615 08:08:28.009470 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 159 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:28.009565 13497 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 159 FOLLOWER]: Leader election lost for term 159. Reason: could not achieve majority
I20260615 08:08:28.012686 13580 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 157 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:28.012749 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 157 FOLLOWER]: Advancing to term 158
I20260615 08:08:28.013262 13580 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 158 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.013444 13580 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 158 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:28.013630 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 158 candidate_status { last_received { term: 157 index: 14412 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:28.013628 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 158 candidate_status { last_received { term: 157 index: 14412 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:28.013722 13401 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 159 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 158. Current term is 159.
I20260615 08:08:28.013729 13250 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 159 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 158. Current term is 159.
I20260615 08:08:28.013885 13289 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 158 election: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 159 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 158. Current term is 159.
I20260615 08:08:28.013949 13289 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 158 election: Cancelling election due to peer responding with higher term
I20260615 08:08:28.014030 13289 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 158 election: Vote denied by peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 159 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 158. Current term is 159.
I20260615 08:08:28.014036 13668 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 159 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:28.014020 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 158 FOLLOWER]: Advancing to term 159
I20260615 08:08:28.014173 13668 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 159 FOLLOWER]: Advancing to term 160
I20260615 08:08:28.014851 13580 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 159 FOLLOWER]: Leader election lost for term 158. Reason: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 159 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 158. Current term is 159.
I20260615 08:08:28.014851 13668 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 160 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.015015 13668 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 160 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:28.015141 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 160 candidate_status { last_received { term: 157 index: 14412 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:28.015157 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 160 candidate_status { last_received { term: 157 index: 14412 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:28.015249 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 159 FOLLOWER]: Advancing to term 160
I20260615 08:08:28.015254 13326 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 159 FOLLOWER]: Advancing to term 160
I20260615 08:08:28.015805 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 160 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 160.
I20260615 08:08:28.015805 13326 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 160 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 160.
I20260615 08:08:28.016053 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 160 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters:
I20260615 08:08:28.016162 13668 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 160 FOLLOWER]: Leader election won for term 160
I20260615 08:08:28.016239 13668 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 160 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:28.016299 13668 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14412, Committed index: 14412, Last appended: 157.14412, Last appended by leader: 14412, Current term: 160, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.016708 13146 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 157 to 160, leader changed from 666bbeda390e4798abb1630585e244a1 (127.4.42.193) to b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195). New cstate: current_term: 160 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:28.049108 13497 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 160 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:28.049191 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 160 FOLLOWER]: Advancing to term 161
I20260615 08:08:28.049705 13497 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 161 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.049845 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 161 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 160. Current term is 161. Ops: []
I20260615 08:08:28.049885 13497 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 161 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:28.050005 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 161 candidate_status { last_received { term: 157 index: 14412 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:28.050093 13326 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 160 FOLLOWER]: Advancing to term 161
I20260615 08:08:28.050035 13668 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14413, Last known committed idx: 14412, Time since last communication: 0.000s
I20260615 08:08:28.050005 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 161 candidate_status { last_received { term: 157 index: 14412 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:28.050806 13326 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 161 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 161.
I20260615 08:08:28.050894 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 161 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 160. Current term is 161. Ops: []
I20260615 08:08:28.051009 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 161 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters: b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:28.051059 13654 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14413, Last known committed idx: 14412, Time since last communication: 0.000s
I20260615 08:08:28.051148 13497 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 161 FOLLOWER]: Leader election won for term 161
I20260615 08:08:28.051209 13497 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 161 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:28.051256 13497 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14412, Committed index: 14412, Last appended: 157.14412, Last appended by leader: 14412, Current term: 161, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.051669 13146 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 160 to 161, leader changed from b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195) to 666bbeda390e4798abb1630585e244a1 (127.4.42.193). New cstate: current_term: 161 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:28.052299 13669 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 160 LEADER]: Stepping down as leader of term 160
I20260615 08:08:28.052340 13669 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 160 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:28.052407 13669 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14412, Committed index: 14412, Last appended: 160.14413, Last appended by leader: 14413, Current term: 160, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.052476 13669 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 160 FOLLOWER]: Advancing to term 161
I20260615 08:08:28.079022 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 161 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 157 index: 14412. Preceding OpId from leader: term: 161 index: 14413. (index mismatch)
I20260615 08:08:28.079262 13497 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14413, Last known committed idx: 14412, Time since last communication: 0.000s
I20260615 08:08:28.080668 13668 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 161 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:28.080732 13668 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 161 FOLLOWER]: Advancing to term 162
I20260615 08:08:28.081321 13668 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 162 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.081473 13668 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 162 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:28.081576 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 162 candidate_status { last_received { term: 160 index: 14413 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:28.081610 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 162 candidate_status { last_received { term: 160 index: 14413 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:28.081794 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 162 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:28.081889 13668 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 162 FOLLOWER]: Leader election lost for term 162. Reason: could not achieve majority
I20260615 08:08:28.087106 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 162 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 161. Current term is 162. Ops: []
I20260615 08:08:28.087354 13497 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14413, Last known committed idx: 14412, Time since last communication: 0.000s
I20260615 08:08:28.087436 13497 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer b97b73a5f2ad444eb230680e3c3fcb6c log is divergent from this leader: its last log entry 160.14413 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14412
I20260615 08:08:28.092474 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 162 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 161. Current term is 162. Ops: [161.14413-161.14413]
I20260615 08:08:28.092664 13497 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14413, Last known committed idx: 14412, Time since last communication: 0.000s
I20260615 08:08:28.092737 13497 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer b97b73a5f2ad444eb230680e3c3fcb6c log is divergent from this leader: its last log entry 160.14413 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14412
I20260615 08:08:28.118506 13588 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 161 LEADER]: Stepping down as leader of term 161
I20260615 08:08:28.118563 13588 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 161 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:28.118664 13588 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14413, Committed index: 14413, Last appended: 161.14413, Last appended by leader: 14413, Current term: 161, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.118738 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 161 FOLLOWER]: Advancing to term 162
I20260615 08:08:28.126533 13669 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 162 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:28.126582 13669 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 162 FOLLOWER]: Advancing to term 163
I20260615 08:08:28.127058 13669 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 163 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.127202 13669 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 163 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:28.127373 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 163 candidate_status { last_received { term: 160 index: 14413 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:28.127409 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 163 candidate_status { last_received { term: 160 index: 14413 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:28.127440 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 162 FOLLOWER]: Advancing to term 163
I20260615 08:08:28.128012 13250 raft_consensus.cc:2410] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 163 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for term 163 because replica has last-logged OpId of term: 161 index: 14413, which is greater than that of the candidate, which has last-logged OpId of term: 160 index: 14413.
I20260615 08:08:28.128201 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 163 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:28.128293 13669 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 163 FOLLOWER]: Leader election lost for term 163. Reason: could not achieve majority
I20260615 08:08:28.135931 13580 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 161 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:28.135984 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 161 FOLLOWER]: Advancing to term 162
I20260615 08:08:28.136480 13580 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 162 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.136603 13580 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 162 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:28.136775 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 162 candidate_status { last_received { term: 161 index: 14413 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:28.136883 13250 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 163 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 162. Current term is 163.
I20260615 08:08:28.136817 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 162 candidate_status { last_received { term: 161 index: 14413 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:28.136929 13401 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 163 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 162. Current term is 163.
I20260615 08:08:28.137038 13289 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 162 election: Vote denied by peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 163 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 162. Current term is 163.
I20260615 08:08:28.137089 13289 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 162 election: Cancelling election due to peer responding with higher term
I20260615 08:08:28.137176 13289 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 162 election: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 163 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 162. Current term is 163.
I20260615 08:08:28.137179 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 162 FOLLOWER]: Advancing to term 163
I20260615 08:08:28.137697 13580 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 163 FOLLOWER]: Leader election lost for term 162. Reason: Vote denied by peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 163 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 162. Current term is 163.
I20260615 08:08:28.143224 13497 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 163 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:28.143275 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 163 FOLLOWER]: Advancing to term 164
I20260615 08:08:28.143757 13497 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 164 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.143963 13497 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 164 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:28.144023 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 164 candidate_status { last_received { term: 161 index: 14413 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:28.144033 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 164 candidate_status { last_received { term: 161 index: 14413 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:28.144120 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 163 FOLLOWER]: Advancing to term 164
I20260615 08:08:28.144124 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 163 FOLLOWER]: Advancing to term 164
I20260615 08:08:28.144731 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 164 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 164.
I20260615 08:08:28.144731 13401 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 164 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 164.
I20260615 08:08:28.144910 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 164 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters:
I20260615 08:08:28.145020 13497 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 164 FOLLOWER]: Leader election won for term 164
I20260615 08:08:28.145078 13497 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 164 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:28.145123 13497 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14413, Committed index: 14413, Last appended: 161.14413, Last appended by leader: 14413, Current term: 164, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.145571 13146 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 161 to 164. New cstate: current_term: 164 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
W20260615 08:08:28.148415 13588 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 162 current term: 164 is higher.
I20260615 08:08:28.172852 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 164 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 160 index: 14413. Preceding OpId from leader: term: 164 index: 14414. (index mismatch)
I20260615 08:08:28.173130 13588 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14414, Last known committed idx: 14412, Time since last communication: 0.000s
I20260615 08:08:28.173202 13588 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer b97b73a5f2ad444eb230680e3c3fcb6c log is divergent from this leader: its last log entry 160.14413 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14412
I20260615 08:08:28.173467 13401 pending_rounds.cc:85] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c: Aborting all ops after (but not including) 14412
I20260615 08:08:28.173519 13401 pending_rounds.cc:107] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c: Aborting uncommitted NO_OP operation due to leader change: 160.14413
I20260615 08:08:28.173544 13401 raft_consensus.cc:2889] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 164 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260615 08:08:28.180824 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 164 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 161 index: 14413. Preceding OpId from leader: term: 164 index: 14414. (index mismatch)
I20260615 08:08:28.181054 13497 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14414, Last known committed idx: 14413, Time since last communication: 0.000s
I20260615 08:08:28.231702 13669 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 164 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:28.231789 13669 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 164 FOLLOWER]: Advancing to term 165
I20260615 08:08:28.232703 13669 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 165 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.232867 13669 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 165 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:28.232978 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 165 candidate_status { last_received { term: 164 index: 14414 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:28.233000 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 165 candidate_status { last_received { term: 164 index: 14414 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:28.233135 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 165 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 164. Current term is 165. Ops: []
I20260615 08:08:28.233245 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 165 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:28.233307 13497 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 164.14414, Next index: 14415, Last known committed idx: 14414, Time since last communication: 0.000s
I20260615 08:08:28.233340 13669 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 165 FOLLOWER]: Leader election lost for term 165. Reason: could not achieve majority
I20260615 08:08:28.260584 13468 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 164 LEADER]: Stepping down as leader of term 164
I20260615 08:08:28.260645 13468 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 164 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:28.260694 13468 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14414, Committed index: 14414, Last appended: 164.14414, Last appended by leader: 14414, Current term: 164, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.260813 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 164 FOLLOWER]: Advancing to term 165
I20260615 08:08:28.262598 13580 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 164 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:28.262671 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 164 FOLLOWER]: Advancing to term 165
I20260615 08:08:28.263180 13580 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 165 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.263321 13580 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 165 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:28.263504 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 165 candidate_status { last_received { term: 164 index: 14414 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:28.263564 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 165 candidate_status { last_received { term: 164 index: 14414 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:28.263605 13669 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 165 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:28.263638 13669 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 165 FOLLOWER]: Advancing to term 166
I20260615 08:08:28.264101 13669 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 166 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.264196 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 165 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 165.
I20260615 08:08:28.264240 13669 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 166 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:28.264338 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 166 candidate_status { last_received { term: 164 index: 14414 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:28.264364 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 165 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters:
I20260615 08:08:28.264200 13401 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 166 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 165. Current term is 166.
I20260615 08:08:28.264346 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 166 candidate_status { last_received { term: 164 index: 14414 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:28.264441 13580 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 165 FOLLOWER]: Leader election won for term 165
I20260615 08:08:28.264401 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 165 FOLLOWER]: Advancing to term 166
I20260615 08:08:28.264638 13289 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 165 election: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 166 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 165. Current term is 166.
I20260615 08:08:28.264710 13580 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 165 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:28.264756 13580 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14414, Committed index: 14414, Last appended: 164.14414, Last appended by leader: 14414, Current term: 165, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.265187 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 166 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 166.
I20260615 08:08:28.265197 13146 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 164 to 165, leader changed from 666bbeda390e4798abb1630585e244a1 (127.4.42.193) to d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194). New cstate: current_term: 165 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:28.265385 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 166 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters: d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:28.265493 13669 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 166 FOLLOWER]: Leader election won for term 166
I20260615 08:08:28.265550 13669 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 166 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:28.265588 13669 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14414, Committed index: 14414, Last appended: 164.14414, Last appended by leader: 14414, Current term: 166, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.291266 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 166 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 164 index: 14414. Preceding OpId from leader: term: 166 index: 14415. (index mismatch)
I20260615 08:08:28.291329 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 166 LEADER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 165. Current term is 166. Ops: []
I20260615 08:08:28.291558 13669 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14415, Last known committed idx: 14414, Time since last communication: 0.000s
I20260615 08:08:28.291553 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14415, Last known committed idx: 14414, Time since last communication: 0.000s
I20260615 08:08:28.291683 13580 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer b97b73a5f2ad444eb230680e3c3fcb6c log is divergent from this leader: its last log entry 166.14415 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14414
I20260615 08:08:28.295012 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 165 to 166, leader changed from d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194) to b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195). New cstate: current_term: 166 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:28.295189 13325 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 165 LEADER]: Stepping down as leader of term 165
I20260615 08:08:28.295246 13325 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 165 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:28.295298 13325 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14414, Committed index: 14414, Last appended: 165.14415, Last appended by leader: 14415, Current term: 165, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.295401 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 165 FOLLOWER]: Advancing to term 166
I20260615 08:08:28.295969 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 166 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 165 index: 14415. Preceding OpId from leader: term: 166 index: 14415. (term mismatch)
I20260615 08:08:28.296026 13325 pending_rounds.cc:85] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f: Aborting all ops after (but not including) 14414
I20260615 08:08:28.296047 13325 pending_rounds.cc:107] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f: Aborting uncommitted NO_OP operation due to leader change: 165.14415
I20260615 08:08:28.296069 13325 raft_consensus.cc:2889] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 166 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260615 08:08:28.296362 13669 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14415, Last known committed idx: 14414, Time since last communication: 0.000s
I20260615 08:08:28.350589 13468 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 166 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:28.350660 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 166 FOLLOWER]: Advancing to term 167
I20260615 08:08:28.351238 13468 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 167 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.351387 13468 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 167 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:28.351500 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 167 candidate_status { last_received { term: 166 index: 14415 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:28.351562 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 167 candidate_status { last_received { term: 166 index: 14415 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:28.351791 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 167 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:28.351881 13468 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 167 FOLLOWER]: Leader election lost for term 167. Reason: could not achieve majority
I20260615 08:08:28.357092 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 167 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 166. Current term is 167. Ops: []
I20260615 08:08:28.357309 13654 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 166.14415, Next index: 14416, Last known committed idx: 14415, Time since last communication: 0.000s
I20260615 08:08:28.380141 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 166 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:28.380228 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 166 FOLLOWER]: Advancing to term 167
I20260615 08:08:28.380859 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 167 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.381045 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 167 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 166. Current term is 167. Ops: []
I20260615 08:08:28.381081 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 167 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:28.381228 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 167 candidate_status { last_received { term: 166 index: 14415 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:28.381233 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 167 candidate_status { last_received { term: 166 index: 14415 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:28.381343 13250 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 167 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f in current term 167: Already voted for candidate 666bbeda390e4798abb1630585e244a1 in this term.
I20260615 08:08:28.381377 13654 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 166.14415, Next index: 14416, Last known committed idx: 14415, Time since last communication: 0.000s
I20260615 08:08:28.381516 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 167 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:28.381647 13522 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 167 FOLLOWER]: Leader election lost for term 167. Reason: could not achieve majority
I20260615 08:08:28.388377 13468 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 167 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:28.388445 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 167 FOLLOWER]: Advancing to term 168
I20260615 08:08:28.389083 13468 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 168 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.389269 13468 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 168 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:28.389427 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 168 candidate_status { last_received { term: 166 index: 14415 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:28.389446 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 168 candidate_status { last_received { term: 166 index: 14415 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:28.389525 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 167 FOLLOWER]: Advancing to term 168
I20260615 08:08:28.390105 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 168 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 168.
I20260615 08:08:28.390307 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 168 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters: b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:28.390420 13468 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 168 FOLLOWER]: Leader election won for term 168
I20260615 08:08:28.390532 13669 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 166 LEADER]: Stepping down as leader of term 166
I20260615 08:08:28.390522 13468 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 168 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:28.390614 13669 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 166 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:28.390646 13468 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14415, Committed index: 14415, Last appended: 166.14415, Last appended by leader: 14415, Current term: 168, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.390659 13669 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14415, Committed index: 14415, Last appended: 166.14415, Last appended by leader: 14415, Current term: 166, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.390738 13669 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 166 FOLLOWER]: Advancing to term 167
I20260615 08:08:28.391125 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 166 to 168, leader changed from b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195) to 666bbeda390e4798abb1630585e244a1 (127.4.42.193). New cstate: current_term: 168 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:28.415367 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 168 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 166 index: 14415. Preceding OpId from leader: term: 168 index: 14416. (index mismatch)
I20260615 08:08:28.415664 13468 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14416, Last known committed idx: 14415, Time since last communication: 0.000s
I20260615 08:08:28.419013 13654 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 167 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:28.419102 13654 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 167 FOLLOWER]: Advancing to term 168
I20260615 08:08:28.419687 13654 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 168 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.419840 13654 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 168 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:28.419971 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 168 candidate_status { last_received { term: 166 index: 14415 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:28.419946 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 168 candidate_status { last_received { term: 166 index: 14415 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:28.420182 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 168 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:28.420271 13654 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 168 FOLLOWER]: Leader election lost for term 168. Reason: could not achieve majority
I20260615 08:08:28.426613 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 168 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 166 index: 14415. Preceding OpId from leader: term: 168 index: 14416. (index mismatch)
I20260615 08:08:28.426831 13468 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14416, Last known committed idx: 14415, Time since last communication: 0.000s
I20260615 08:08:28.473377 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 168 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:28.473452 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 168 FOLLOWER]: Advancing to term 169
I20260615 08:08:28.474053 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 169 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.474201 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 169 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:28.474375 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 169 candidate_status { last_received { term: 168 index: 14416 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:28.474411 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 169 candidate_status { last_received { term: 168 index: 14416 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:28.474694 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 169 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:28.474812 13522 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 169 FOLLOWER]: Leader election lost for term 169. Reason: could not achieve majority
I20260615 08:08:28.477873 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 169 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 168. Current term is 169. Ops: []
I20260615 08:08:28.478103 13468 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 168.14416, Next index: 14417, Last known committed idx: 14416, Time since last communication: 0.000s
I20260615 08:08:28.498302 13468 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 168 LEADER]: Stepping down as leader of term 168
I20260615 08:08:28.498356 13468 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 168 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:28.498468 13468 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14416, Committed index: 14416, Last appended: 168.14416, Last appended by leader: 14416, Current term: 168, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.498605 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 168 FOLLOWER]: Advancing to term 169
I20260615 08:08:28.509486 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 169 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:28.509567 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 169 FOLLOWER]: Advancing to term 170
I20260615 08:08:28.510108 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 170 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.510260 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 170 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:28.510514 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 170 candidate_status { last_received { term: 168 index: 14416 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:28.510536 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 170 candidate_status { last_received { term: 168 index: 14416 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:28.510615 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 168 FOLLOWER]: Advancing to term 170
I20260615 08:08:28.510622 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 169 FOLLOWER]: Advancing to term 170
I20260615 08:08:28.511250 13250 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 170 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 170.
I20260615 08:08:28.511250 13401 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 170 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 170.
I20260615 08:08:28.511447 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 170 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f; no voters:
I20260615 08:08:28.511523 13522 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 170 FOLLOWER]: Leader election won for term 170
I20260615 08:08:28.511583 13522 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 170 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:28.511634 13522 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14416, Committed index: 14416, Last appended: 168.14416, Last appended by leader: 14416, Current term: 170, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.512001 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 168 to 170, leader changed from 666bbeda390e4798abb1630585e244a1 (127.4.42.193) to d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194). New cstate: current_term: 170 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:28.538225 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 170 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 168 index: 14416. Preceding OpId from leader: term: 170 index: 14417. (index mismatch)
I20260615 08:08:28.538471 13522 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14417, Last known committed idx: 14416, Time since last communication: 0.000s
I20260615 08:08:28.539299 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 170 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 168 index: 14416. Preceding OpId from leader: term: 170 index: 14417. (index mismatch)
I20260615 08:08:28.539575 13522 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14417, Last known committed idx: 14416, Time since last communication: 0.000s
I20260615 08:08:28.570717 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 170 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:28.570791 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 170 FOLLOWER]: Advancing to term 171
I20260615 08:08:28.571389 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 171 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.571569 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 171 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:28.571719 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 171 candidate_status { last_received { term: 170 index: 14417 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:28.571758 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 171 candidate_status { last_received { term: 170 index: 14417 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:28.571972 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 171 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:28.572089 13588 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 171 FOLLOWER]: Leader election lost for term 171. Reason: could not achieve majority
I20260615 08:08:28.576560 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 171 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 170. Current term is 171. Ops: []
I20260615 08:08:28.576763 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 170.14417, Next index: 14418, Last known committed idx: 14417, Time since last communication: 0.000s
I20260615 08:08:28.603451 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 171 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:28.603528 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 171 FOLLOWER]: Advancing to term 172
I20260615 08:08:28.604112 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 172 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.604290 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 172 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:28.604408 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 172 candidate_status { last_received { term: 170 index: 14417 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:28.604461 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 172 candidate_status { last_received { term: 170 index: 14417 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:28.604616 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 172 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:28.604709 13588 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 172 FOLLOWER]: Leader election lost for term 172. Reason: could not achieve majority
I20260615 08:08:28.613391 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 172 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 170. Current term is 172. Ops: []
I20260615 08:08:28.613651 13689 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 170.14417, Next index: 14418, Last known committed idx: 14417, Time since last communication: 0.000s
I20260615 08:08:28.645537 13250 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 172 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 170. Current term is 172. Ops: []
I20260615 08:08:28.645779 13689 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 170.14417, Next index: 14418, Last known committed idx: 14417, Time since last communication: 0.000s
I20260615 08:08:28.668722 13522 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 170 LEADER]: Stepping down as leader of term 170
I20260615 08:08:28.668802 13522 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 170 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:28.668866 13522 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14417, Committed index: 14417, Last appended: 170.14417, Last appended by leader: 14417, Current term: 170, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.668964 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 170 FOLLOWER]: Advancing to term 171
I20260615 08:08:28.670224 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 172 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:28.670275 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 172 FOLLOWER]: Advancing to term 173
I20260615 08:08:28.670794 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 173 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.670934 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 173 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:28.671079 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 173 candidate_status { last_received { term: 170 index: 14417 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:28.671125 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 173 candidate_status { last_received { term: 170 index: 14417 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:28.671180 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 171 FOLLOWER]: Advancing to term 173
I20260615 08:08:28.671757 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 173 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 173.
I20260615 08:08:28.671963 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 173 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters: b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:28.672092 13588 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 173 FOLLOWER]: Leader election won for term 173
I20260615 08:08:28.672144 13588 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 173 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:28.672183 13588 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14417, Committed index: 14417, Last appended: 170.14417, Last appended by leader: 14417, Current term: 173, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.672655 13146 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 170 to 173, leader changed from d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194) to 666bbeda390e4798abb1630585e244a1 (127.4.42.193). New cstate: current_term: 173 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:28.679634 13669 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 170 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:28.679705 13669 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 170 FOLLOWER]: Advancing to term 171
I20260615 08:08:28.680217 13669 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 171 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.680352 13669 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 171 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:28.680486 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 171 candidate_status { last_received { term: 170 index: 14417 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:28.680487 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 171 candidate_status { last_received { term: 170 index: 14417 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:28.680585 13325 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 173 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 171. Current term is 173.
I20260615 08:08:28.680737 13366 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 171 election: Vote denied by peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 173 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 171. Current term is 173.
I20260615 08:08:28.680770 13366 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 171 election: Cancelling election due to peer responding with higher term
I20260615 08:08:28.680845 13669 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 171 FOLLOWER]: Advancing to term 173
I20260615 08:08:28.681355 13669 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 173 FOLLOWER]: Leader election lost for term 171. Reason: Vote denied by peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 173 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 171. Current term is 173.
I20260615 08:08:28.700666 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 173 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 170 index: 14417. Preceding OpId from leader: term: 173 index: 14418. (index mismatch)
I20260615 08:08:28.700817 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 173 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 170 index: 14417. Preceding OpId from leader: term: 173 index: 14418. (index mismatch)
I20260615 08:08:28.700897 13588 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14418, Last known committed idx: 14417, Time since last communication: 0.000s
I20260615 08:08:28.701031 13588 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14418, Last known committed idx: 14417, Time since last communication: 0.000s
I20260615 08:08:28.732252 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 173 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:28.732324 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 173 FOLLOWER]: Advancing to term 174
I20260615 08:08:28.732898 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 174 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.733047 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 174 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:28.733233 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 174 candidate_status { last_received { term: 173 index: 14418 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:28.733237 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 174 candidate_status { last_received { term: 173 index: 14418 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:28.733386 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 174 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 173. Current term is 174. Ops: []
I20260615 08:08:28.733527 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 174 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:28.733587 13588 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 173.14418, Next index: 14419, Last known committed idx: 14418, Time since last communication: 0.000s
I20260615 08:08:28.733657 13522 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 174 FOLLOWER]: Leader election lost for term 174. Reason: could not achieve majority
I20260615 08:08:28.756618 13669 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 173 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:28.756702 13669 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 173 FOLLOWER]: Advancing to term 174
I20260615 08:08:28.757292 13669 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 174 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.757457 13669 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 174 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:28.757656 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 174 candidate_status { last_received { term: 173 index: 14418 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:28.757683 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 174 candidate_status { last_received { term: 173 index: 14418 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:28.757766 13325 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 174 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c in current term 174: Already voted for candidate d4d7c2ebbf334b19a7f964aab04f280f in this term.
I20260615 08:08:28.757923 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 174 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:28.758029 13669 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 174 FOLLOWER]: Leader election lost for term 174. Reason: could not achieve majority
I20260615 08:08:28.760279 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 174 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 173. Current term is 174. Ops: []
I20260615 08:08:28.760514 13588 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 173.14418, Next index: 14419, Last known committed idx: 14418, Time since last communication: 0.000s
I20260615 08:08:28.770349 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 174 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 173. Current term is 174. Ops: []
I20260615 08:08:28.770613 13588 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 173.14418, Next index: 14419, Last known committed idx: 14418, Time since last communication: 0.000s
I20260615 08:08:28.774674 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 174 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:28.774740 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 174 FOLLOWER]: Advancing to term 175
I20260615 08:08:28.775354 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 175 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.775501 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 175 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:28.775704 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 175 candidate_status { last_received { term: 173 index: 14418 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:28.775704 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 175 candidate_status { last_received { term: 173 index: 14418 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:28.775806 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 174 FOLLOWER]: Advancing to term 175
I20260615 08:08:28.776372 13401 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 175 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 175.
I20260615 08:08:28.776537 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 175 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1
I20260615 08:08:28.776641 13522 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 175 FOLLOWER]: Leader election won for term 175
I20260615 08:08:28.776695 13522 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 175 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:28.776742 13522 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14418, Committed index: 14418, Last appended: 173.14418, Last appended by leader: 14418, Current term: 175, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.777148 13146 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 173 to 175, leader changed from 666bbeda390e4798abb1630585e244a1 (127.4.42.193) to d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194). New cstate: current_term: 175 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:28.783612 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 175 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 173. Current term is 175. Ops: []
I20260615 08:08:28.783844 13468 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 173.14418, Next index: 14419, Last known committed idx: 14418, Time since last communication: 0.000s
I20260615 08:08:28.786353 13497 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 173 LEADER]: Stepping down as leader of term 173
I20260615 08:08:28.786396 13497 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 173 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:28.786458 13497 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14418, Committed index: 14418, Last appended: 173.14418, Last appended by leader: 14418, Current term: 173, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.786571 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 173 FOLLOWER]: Advancing to term 174
I20260615 08:08:28.806409 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 174 FOLLOWER]: Advancing to term 175
I20260615 08:08:28.806988 13250 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 175 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 173 index: 14418. Preceding OpId from leader: term: 175 index: 14419. (index mismatch)
I20260615 08:08:28.807235 13522 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14419, Last known committed idx: 14418, Time since last communication: 0.000s
I20260615 08:08:28.808465 13669 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 175 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:28.808537 13669 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 175 FOLLOWER]: Advancing to term 176
I20260615 08:08:28.809034 13669 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 176 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.809192 13669 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 176 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:28.809334 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 176 candidate_status { last_received { term: 173 index: 14418 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:28.809350 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 176 candidate_status { last_received { term: 173 index: 14418 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:28.809599 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 176 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:28.809695 13669 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 176 FOLLOWER]: Leader election lost for term 176. Reason: could not achieve majority
I20260615 08:08:28.810578 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 176 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 175. Current term is 176. Ops: []
I20260615 08:08:28.810791 13522 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14419, Last known committed idx: 14418, Time since last communication: 0.000s
I20260615 08:08:28.817512 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 176 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 175. Current term is 176. Ops: [175.14419-175.14419]
I20260615 08:08:28.817725 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 173.14418, Next index: 14419, Last known committed idx: 14418, Time since last communication: 0.000s
I20260615 08:08:28.838984 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 175 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:28.839061 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 175 FOLLOWER]: Advancing to term 176
I20260615 08:08:28.839684 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 176 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.839838 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 176 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:28.840029 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 176 candidate_status { last_received { term: 175 index: 14419 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:28.840050 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 176 candidate_status { last_received { term: 175 index: 14419 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:28.840167 13401 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 176 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 in current term 176: Already voted for candidate b97b73a5f2ad444eb230680e3c3fcb6c in this term.
I20260615 08:08:28.840355 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 176 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:28.840461 13588 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 176 FOLLOWER]: Leader election lost for term 176. Reason: could not achieve majority
I20260615 08:08:28.842113 13669 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 176 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:28.842171 13669 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 176 FOLLOWER]: Advancing to term 177
I20260615 08:08:28.842716 13669 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 177 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.842849 13669 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 177 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:28.843016 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 177 candidate_status { last_received { term: 173 index: 14418 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:28.843135 13250 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 176 FOLLOWER]: Advancing to term 177
I20260615 08:08:28.843020 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 177 candidate_status { last_received { term: 173 index: 14418 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:28.843737 13250 raft_consensus.cc:2410] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 177 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for term 177 because replica has last-logged OpId of term: 175 index: 14419, which is greater than that of the candidate, which has last-logged OpId of term: 173 index: 14418.
I20260615 08:08:28.843848 13249 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 177 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 175. Current term is 177. Ops: []
I20260615 08:08:28.843909 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 177 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:28.844004 13669 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 177 FOLLOWER]: Leader election lost for term 177. Reason: could not achieve majority
I20260615 08:08:28.844086 13522 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 175.14419, Next index: 14420, Last known committed idx: 14419, Time since last communication: 0.000s
I20260615 08:08:28.848412 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 177 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 175. Current term is 177. Ops: [175.14419-175.14419]
I20260615 08:08:28.848642 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 173.14418, Next index: 14419, Last known committed idx: 14418, Time since last communication: 0.000s
I20260615 08:08:28.858595 13689 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 175 LEADER]: Stepping down as leader of term 175
I20260615 08:08:28.858656 13689 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 175 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:28.858706 13689 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14419, Committed index: 14419, Last appended: 175.14419, Last appended by leader: 14419, Current term: 175, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.858814 13689 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 175 FOLLOWER]: Advancing to term 176
I20260615 08:08:28.872890 13497 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 177 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:28.872941 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 177 FOLLOWER]: Advancing to term 178
I20260615 08:08:28.873420 13497 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 178 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.873571 13497 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 178 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:28.873757 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 178 candidate_status { last_received { term: 175 index: 14419 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:28.873765 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 178 candidate_status { last_received { term: 175 index: 14419 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:28.873829 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 177 FOLLOWER]: Advancing to term 178
I20260615 08:08:28.873838 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 176 FOLLOWER]: Advancing to term 178
I20260615 08:08:28.874358 13401 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 178 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 178.
I20260615 08:08:28.874481 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 178 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 178.
I20260615 08:08:28.874596 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 178 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters:
I20260615 08:08:28.874702 13497 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 178 FOLLOWER]: Leader election won for term 178
I20260615 08:08:28.874778 13497 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 178 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:28.874830 13497 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14419, Committed index: 14419, Last appended: 175.14419, Last appended by leader: 14419, Current term: 178, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.875268 13146 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 175 to 178, leader changed from d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194) to 666bbeda390e4798abb1630585e244a1 (127.4.42.193). New cstate: current_term: 178 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:28.901441 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 178 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 175 index: 14419. Preceding OpId from leader: term: 178 index: 14420. (index mismatch)
I20260615 08:08:28.901767 13497 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14420, Last known committed idx: 14419, Time since last communication: 0.000s
W20260615 08:08:28.905890 13459 lock_manager.cc:494] Txn 8 has not acquired the partition lock after 1000ms
I20260615 08:08:28.907546 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 178 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 173 index: 14418. Preceding OpId from leader: term: 178 index: 14420. (index mismatch)
I20260615 08:08:28.907747 13497 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14420, Last known committed idx: 14418, Time since last communication: 0.000s
I20260615 08:08:28.986347 13689 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 178 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:28.986423 13689 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 178 FOLLOWER]: Advancing to term 179
I20260615 08:08:28.987102 13689 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 179 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:28.987246 13689 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 179 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:28.987480 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 179 candidate_status { last_received { term: 178 index: 14420 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:28.987515 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 179 candidate_status { last_received { term: 178 index: 14420 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:28.987766 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 179 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:28.987854 13689 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 179 FOLLOWER]: Leader election lost for term 179. Reason: could not achieve majority
I20260615 08:08:28.990811 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 179 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 178. Current term is 179. Ops: []
I20260615 08:08:28.991139 13468 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 178.14420, Next index: 14421, Last known committed idx: 14420, Time since last communication: 0.000s
I20260615 08:08:29.004341 13497 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 178 LEADER]: Stepping down as leader of term 178
I20260615 08:08:29.004388 13497 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 178 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:29.004429 13497 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14420, Committed index: 14420, Last appended: 178.14420, Last appended by leader: 14420, Current term: 178, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.004480 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 178 FOLLOWER]: Advancing to term 179
I20260615 08:08:29.019434 13669 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 178 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:29.019501 13669 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 178 FOLLOWER]: Advancing to term 179
I20260615 08:08:29.020048 13669 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 179 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.020233 13669 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 179 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:29.020408 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 179 candidate_status { last_received { term: 178 index: 14420 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:29.020413 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 179 candidate_status { last_received { term: 178 index: 14420 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:29.020507 13325 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 179 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c in current term 179: Already voted for candidate d4d7c2ebbf334b19a7f964aab04f280f in this term.
I20260615 08:08:29.021124 13249 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 179 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 179.
I20260615 08:08:29.021304 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 179 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters: d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:29.021399 13669 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 179 FOLLOWER]: Leader election won for term 179
I20260615 08:08:29.021459 13669 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 179 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:29.021524 13669 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14420, Committed index: 14420, Last appended: 178.14420, Last appended by leader: 14420, Current term: 179, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.021929 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 178 to 179, leader changed from 666bbeda390e4798abb1630585e244a1 (127.4.42.193) to b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195). New cstate: current_term: 179 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:29.022316 13689 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 179 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:29.022363 13689 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 179 FOLLOWER]: Advancing to term 180
I20260615 08:08:29.022923 13689 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 180 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.023080 13689 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 180 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:29.023259 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 180 candidate_status { last_received { term: 178 index: 14420 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:29.023272 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 180 candidate_status { last_received { term: 178 index: 14420 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:29.023347 13249 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 179 FOLLOWER]: Advancing to term 180
I20260615 08:08:29.023849 13249 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 180 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 180.
I20260615 08:08:29.024006 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 180 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters: b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:29.024104 13689 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 180 FOLLOWER]: Leader election won for term 180
I20260615 08:08:29.024189 13689 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 180 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:29.024241 13689 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14420, Committed index: 14420, Last appended: 178.14420, Last appended by leader: 14420, Current term: 180, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.053285 13249 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 180 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 179. Current term is 180. Ops: []
I20260615 08:08:29.053638 13654 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14421, Last known committed idx: 14420, Time since last communication: 0.000s
I20260615 08:08:29.053733 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 179 to 180, leader changed from b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195) to d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194). New cstate: current_term: 180 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:29.053896 13249 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 180 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 178 index: 14420. Preceding OpId from leader: term: 180 index: 14421. (index mismatch)
I20260615 08:08:29.053962 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 180 LEADER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 179. Current term is 180. Ops: []
I20260615 08:08:29.054173 13669 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14421, Last known committed idx: 14420, Time since last communication: 0.000s
I20260615 08:08:29.054174 13689 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14421, Last known committed idx: 14420, Time since last communication: 0.000s
I20260615 08:08:29.054283 13669 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer d4d7c2ebbf334b19a7f964aab04f280f log is divergent from this leader: its last log entry 180.14421 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14420
I20260615 08:08:29.058913 13401 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 179 LEADER]: Stepping down as leader of term 179
I20260615 08:08:29.058966 13401 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 179 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:29.059021 13401 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14420, Committed index: 14420, Last appended: 179.14421, Last appended by leader: 14421, Current term: 179, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.059098 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 179 FOLLOWER]: Advancing to term 180
I20260615 08:08:29.059561 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 180 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 179 index: 14421. Preceding OpId from leader: term: 180 index: 14421. (term mismatch)
I20260615 08:08:29.059604 13401 pending_rounds.cc:85] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c: Aborting all ops after (but not including) 14420
I20260615 08:08:29.059617 13401 pending_rounds.cc:107] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c: Aborting uncommitted NO_OP operation due to leader change: 179.14421
I20260615 08:08:29.059630 13401 raft_consensus.cc:2889] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 180 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260615 08:08:29.059844 13689 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14421, Last known committed idx: 14420, Time since last communication: 0.000s
I20260615 08:08:29.110397 13497 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 180 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:29.110487 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 180 FOLLOWER]: Advancing to term 181
I20260615 08:08:29.111085 13497 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 181 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.111241 13497 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 181 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:29.111373 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 181 candidate_status { last_received { term: 180 index: 14421 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:29.111436 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 181 candidate_status { last_received { term: 180 index: 14421 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:29.111645 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 181 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:29.111749 13497 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 181 FOLLOWER]: Leader election lost for term 181. Reason: could not achieve majority
I20260615 08:08:29.113375 13654 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 180 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:29.113413 13654 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 180 FOLLOWER]: Advancing to term 181
I20260615 08:08:29.113884 13654 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 181 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.114017 13654 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 181 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:29.114161 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 181 candidate_status { last_received { term: 180 index: 14421 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:29.114234 13249 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 181 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c in current term 181: Already voted for candidate 666bbeda390e4798abb1630585e244a1 in this term.
I20260615 08:08:29.114167 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 181 candidate_status { last_received { term: 180 index: 14421 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:29.114435 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 181 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:29.114573 13654 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 181 FOLLOWER]: Leader election lost for term 181. Reason: could not achieve majority
I20260615 08:08:29.114785 13249 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 181 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 180. Current term is 181. Ops: []
I20260615 08:08:29.115010 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 180.14421, Next index: 14422, Last known committed idx: 14421, Time since last communication: 0.000s
I20260615 08:08:29.120055 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 181 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 180. Current term is 181. Ops: []
I20260615 08:08:29.120276 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 180.14421, Next index: 14422, Last known committed idx: 14421, Time since last communication: 0.000s
I20260615 08:08:29.139729 13249 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 181 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 180. Current term is 181. Ops: []
I20260615 08:08:29.139967 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 180.14421, Next index: 14422, Last known committed idx: 14421, Time since last communication: 0.000s
I20260615 08:08:29.147284 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 181 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 180. Current term is 181. Ops: []
I20260615 08:08:29.147544 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 180.14421, Next index: 14422, Last known committed idx: 14421, Time since last communication: 0.000s
I20260615 08:08:29.147671 13497 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 181 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:29.147740 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 181 FOLLOWER]: Advancing to term 182
I20260615 08:08:29.148250 13497 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 182 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.148413 13497 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 182 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:29.148553 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 182 candidate_status { last_received { term: 180 index: 14421 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:29.148558 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 182 candidate_status { last_received { term: 180 index: 14421 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:29.148653 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 181 FOLLOWER]: Advancing to term 182
I20260615 08:08:29.149150 13401 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 182 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 182.
I20260615 08:08:29.149296 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 182 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters: d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:29.149396 13497 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 182 FOLLOWER]: Leader election won for term 182
I20260615 08:08:29.149447 13497 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 182 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:29.149498 13497 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14421, Committed index: 14421, Last appended: 180.14421, Last appended by leader: 14421, Current term: 182, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.149897 13146 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 180 to 182, leader changed from d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194) to 666bbeda390e4798abb1630585e244a1 (127.4.42.193). New cstate: current_term: 182 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:29.158233 13689 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 180 LEADER]: Stepping down as leader of term 180
I20260615 08:08:29.158283 13689 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 180 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:29.158368 13689 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14421, Committed index: 14421, Last appended: 180.14421, Last appended by leader: 14421, Current term: 180, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.158452 13689 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 180 FOLLOWER]: Advancing to term 181
I20260615 08:08:29.174242 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 182 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 180 index: 14421. Preceding OpId from leader: term: 182 index: 14422. (index mismatch)
I20260615 08:08:29.174652 13497 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14422, Last known committed idx: 14421, Time since last communication: 0.000s
I20260615 08:08:29.178347 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 181 FOLLOWER]: Advancing to term 182
I20260615 08:08:29.178946 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 182 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 180 index: 14421. Preceding OpId from leader: term: 182 index: 14422. (index mismatch)
I20260615 08:08:29.179174 13497 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14422, Last known committed idx: 14421, Time since last communication: 0.000s
I20260615 08:08:29.205884 13654 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 182 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:29.205941 13654 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 182 FOLLOWER]: Advancing to term 183
I20260615 08:08:29.206437 13654 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 183 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.206624 13654 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 183 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:29.206773 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 183 candidate_status { last_received { term: 182 index: 14422 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:29.206773 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 183 candidate_status { last_received { term: 182 index: 14422 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:29.206964 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 183 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 182. Current term is 183. Ops: []
I20260615 08:08:29.207023 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 183 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:29.207108 13654 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 183 FOLLOWER]: Leader election lost for term 183. Reason: could not achieve majority
I20260615 08:08:29.207144 13497 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 182.14422, Next index: 14423, Last known committed idx: 14422, Time since last communication: 0.000s
I20260615 08:08:29.209827 13580 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 182 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:29.209870 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 182 FOLLOWER]: Advancing to term 183
I20260615 08:08:29.210381 13580 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 183 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.210523 13580 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 183 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:29.210719 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 183 candidate_status { last_received { term: 182 index: 14422 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:29.210733 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 183 candidate_status { last_received { term: 182 index: 14422 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:29.210834 13401 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 183 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f in current term 183: Already voted for candidate b97b73a5f2ad444eb230680e3c3fcb6c in this term.
I20260615 08:08:29.210960 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 183 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:29.211064 13580 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 183 FOLLOWER]: Leader election lost for term 183. Reason: could not achieve majority
I20260615 08:08:29.212198 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 183 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 182. Current term is 183. Ops: []
I20260615 08:08:29.212392 13588 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 182.14422, Next index: 14423, Last known committed idx: 14422, Time since last communication: 0.000s
I20260615 08:08:29.230590 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 183 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 182. Current term is 183. Ops: []
I20260615 08:08:29.230796 13468 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 182.14422, Next index: 14423, Last known committed idx: 14422, Time since last communication: 0.000s
I20260615 08:08:29.239285 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 183 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 182. Current term is 183. Ops: []
I20260615 08:08:29.239491 13588 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 182.14422, Next index: 14423, Last known committed idx: 14422, Time since last communication: 0.000s
I20260615 08:08:29.241719 13497 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 182 LEADER]: Stepping down as leader of term 182
I20260615 08:08:29.241760 13497 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 182 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:29.241835 13497 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14422, Committed index: 14422, Last appended: 182.14422, Last appended by leader: 14422, Current term: 182, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.241890 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 182 FOLLOWER]: Advancing to term 183
I20260615 08:08:29.244553 13654 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 183 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:29.244616 13654 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 183 FOLLOWER]: Advancing to term 184
I20260615 08:08:29.245147 13654 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 184 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.245292 13654 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 184 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:29.245412 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 184 candidate_status { last_received { term: 182 index: 14422 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:29.245471 13249 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 183 FOLLOWER]: Advancing to term 184
I20260615 08:08:29.245478 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 184 candidate_status { last_received { term: 182 index: 14422 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:29.245621 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 183 FOLLOWER]: Advancing to term 184
I20260615 08:08:29.246117 13249 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 184 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 184.
I20260615 08:08:29.246173 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 184 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 184.
I20260615 08:08:29.246323 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 184 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f; no voters:
I20260615 08:08:29.246428 13654 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 184 FOLLOWER]: Leader election won for term 184
I20260615 08:08:29.246472 13654 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 184 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:29.246539 13654 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14422, Committed index: 14422, Last appended: 182.14422, Last appended by leader: 14422, Current term: 184, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.246873 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 182 to 184, leader changed from 666bbeda390e4798abb1630585e244a1 (127.4.42.193) to b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195). New cstate: current_term: 184 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:29.272140 13249 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 184 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 182 index: 14422. Preceding OpId from leader: term: 184 index: 14423. (index mismatch)
I20260615 08:08:29.272380 13654 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14423, Last known committed idx: 14422, Time since last communication: 0.000s
I20260615 08:08:29.276535 13580 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 184 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:29.276588 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 184 FOLLOWER]: Advancing to term 185
I20260615 08:08:29.277151 13580 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 185 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.277282 13580 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 185 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:29.277406 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 185 candidate_status { last_received { term: 182 index: 14422 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:29.277447 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 185 candidate_status { last_received { term: 182 index: 14422 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:29.277645 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 185 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:29.277732 13580 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 185 FOLLOWER]: Leader election lost for term 185. Reason: could not achieve majority
I20260615 08:08:29.280994 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 185 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 184. Current term is 185. Ops: []
I20260615 08:08:29.281251 13654 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14423, Last known committed idx: 14422, Time since last communication: 0.000s
I20260615 08:08:29.300408 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 185 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 184. Current term is 185. Ops: [184.14423-184.14423]
I20260615 08:08:29.300632 13696 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 182.14422, Next index: 14423, Last known committed idx: 14422, Time since last communication: 0.000s
I20260615 08:08:29.307467 13654 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 184 LEADER]: Stepping down as leader of term 184
I20260615 08:08:29.307510 13654 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 184 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:29.307571 13654 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14423, Committed index: 14423, Last appended: 184.14423, Last appended by leader: 14423, Current term: 184, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.307660 13654 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 184 FOLLOWER]: Advancing to term 185
I20260615 08:08:29.321290 13580 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 185 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:29.321350 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 185 FOLLOWER]: Advancing to term 186
I20260615 08:08:29.321843 13580 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 186 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.321969 13580 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 186 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:29.322124 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 186 candidate_status { last_received { term: 182 index: 14422 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:29.322201 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 186 candidate_status { last_received { term: 182 index: 14422 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:29.322400 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 185 FOLLOWER]: Advancing to term 186
I20260615 08:08:29.322942 13401 raft_consensus.cc:2410] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 186 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for term 186 because replica has last-logged OpId of term: 184 index: 14423, which is greater than that of the candidate, which has last-logged OpId of term: 182 index: 14422.
I20260615 08:08:29.323127 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 186 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:29.323221 13580 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 186 FOLLOWER]: Leader election lost for term 186. Reason: could not achieve majority
I20260615 08:08:29.329188 13468 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 184 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:29.329236 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 184 FOLLOWER]: Advancing to term 185
I20260615 08:08:29.329787 13468 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 185 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.329921 13468 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 185 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:29.330065 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 185 candidate_status { last_received { term: 184 index: 14423 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:29.330134 13325 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 186 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 185. Current term is 186.
I20260615 08:08:29.330078 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 185 candidate_status { last_received { term: 184 index: 14423 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:29.330204 13401 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 186 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 185. Current term is 186.
I20260615 08:08:29.330331 13215 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 185 election: Vote denied by peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 186 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 185. Current term is 186.
I20260615 08:08:29.330369 13215 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 185 election: Cancelling election due to peer responding with higher term
I20260615 08:08:29.330392 13213 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 185 election: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 186 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 185. Current term is 186.
I20260615 08:08:29.330449 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 185 FOLLOWER]: Advancing to term 186
I20260615 08:08:29.330935 13468 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 186 FOLLOWER]: Leader election lost for term 185. Reason: Vote denied by peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 186 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 185. Current term is 186.
I20260615 08:08:29.340464 13654 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 186 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:29.340509 13654 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 186 FOLLOWER]: Advancing to term 187
I20260615 08:08:29.340991 13654 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 187 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.341150 13654 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 187 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:29.341293 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 187 candidate_status { last_received { term: 184 index: 14423 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:29.341337 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 187 candidate_status { last_received { term: 184 index: 14423 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:29.341377 13249 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 186 FOLLOWER]: Advancing to term 187
I20260615 08:08:29.341387 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 186 FOLLOWER]: Advancing to term 187
I20260615 08:08:29.341925 13249 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 187 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 187.
I20260615 08:08:29.341938 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 187 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 187.
I20260615 08:08:29.342139 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 187 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters:
I20260615 08:08:29.342249 13654 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 187 FOLLOWER]: Leader election won for term 187
I20260615 08:08:29.342306 13654 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 187 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:29.342334 13654 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14423, Committed index: 14423, Last appended: 184.14423, Last appended by leader: 14423, Current term: 187, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.342725 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 184 to 187. New cstate: current_term: 187 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:29.367909 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 187 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 182 index: 14422. Preceding OpId from leader: term: 187 index: 14424. (index mismatch)
I20260615 08:08:29.368134 13654 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14424, Last known committed idx: 14422, Time since last communication: 0.000s
I20260615 08:08:29.376890 13249 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 187 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 184 index: 14423. Preceding OpId from leader: term: 187 index: 14424. (index mismatch)
I20260615 08:08:29.377108 13654 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14424, Last known committed idx: 14423, Time since last communication: 0.000s
I20260615 08:08:29.399794 13689 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 187 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:29.399850 13689 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 187 FOLLOWER]: Advancing to term 188
I20260615 08:08:29.400447 13689 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 188 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.400581 13689 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 188 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:29.400775 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 188 candidate_status { last_received { term: 187 index: 14424 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:29.400805 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 188 candidate_status { last_received { term: 187 index: 14424 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:29.400995 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 188 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:29.401090 13689 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 188 FOLLOWER]: Leader election lost for term 188. Reason: could not achieve majority
I20260615 08:08:29.405663 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 188 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 187. Current term is 188. Ops: []
I20260615 08:08:29.405862 13696 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 187.14424, Next index: 14425, Last known committed idx: 14424, Time since last communication: 0.000s
I20260615 08:08:29.432374 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 188 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 187. Current term is 188. Ops: []
I20260615 08:08:29.432626 13654 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 187.14424, Next index: 14425, Last known committed idx: 14424, Time since last communication: 0.000s
I20260615 08:08:29.434499 13696 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 187 LEADER]: Stepping down as leader of term 187
I20260615 08:08:29.434553 13696 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 187 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:29.434629 13696 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14424, Committed index: 14424, Last appended: 187.14424, Last appended by leader: 14424, Current term: 187, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.434728 13696 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 187 FOLLOWER]: Advancing to term 188
I20260615 08:08:29.444408 13689 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 188 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:29.444460 13689 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 188 FOLLOWER]: Advancing to term 189
I20260615 08:08:29.444942 13689 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 189 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.445080 13689 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 189 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:29.445216 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 189 candidate_status { last_received { term: 187 index: 14424 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:29.445256 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 189 candidate_status { last_received { term: 187 index: 14424 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:29.445344 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 188 FOLLOWER]: Advancing to term 189
I20260615 08:08:29.445834 13401 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 189 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 189.
I20260615 08:08:29.446014 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 189 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1
I20260615 08:08:29.446110 13689 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 189 FOLLOWER]: Leader election won for term 189
I20260615 08:08:29.446197 13689 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 189 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:29.446247 13689 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14424, Committed index: 14424, Last appended: 187.14424, Last appended by leader: 14424, Current term: 189, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.446705 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 187 to 189, leader changed from b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195) to d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194). New cstate: current_term: 189 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:29.458586 13497 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 187 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:29.458642 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 187 FOLLOWER]: Advancing to term 188
I20260615 08:08:29.459075 13497 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 188 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.459210 13497 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 188 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:29.459335 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 188 candidate_status { last_received { term: 187 index: 14424 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:29.459355 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 188 candidate_status { last_received { term: 187 index: 14424 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:29.459419 13401 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 189 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 188. Current term is 189.
I20260615 08:08:29.459555 13213 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 188 election: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 189 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 188. Current term is 189.
I20260615 08:08:29.459607 13213 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 188 election: Cancelling election due to peer responding with higher term
I20260615 08:08:29.459669 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 188 FOLLOWER]: Advancing to term 189
I20260615 08:08:29.460124 13497 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 189 FOLLOWER]: Leader election lost for term 188. Reason: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 189 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 188. Current term is 189.
I20260615 08:08:29.471901 13249 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 189 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 187 index: 14424. Preceding OpId from leader: term: 189 index: 14425. (index mismatch)
I20260615 08:08:29.472137 13689 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14425, Last known committed idx: 14424, Time since last communication: 0.000s
I20260615 08:08:29.478965 13696 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 189 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:29.479028 13696 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 189 FOLLOWER]: Advancing to term 190
I20260615 08:08:29.479559 13696 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 190 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.479699 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 190 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 189. Current term is 190. Ops: []
I20260615 08:08:29.479727 13696 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 190 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:29.479831 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 190 candidate_status { last_received { term: 187 index: 14424 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:29.479864 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 190 candidate_status { last_received { term: 187 index: 14424 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:29.479894 13689 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14425, Last known committed idx: 14424, Time since last communication: 0.000s
I20260615 08:08:29.480108 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 190 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:29.480211 13696 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 190 FOLLOWER]: Leader election lost for term 190. Reason: could not achieve majority
I20260615 08:08:29.483028 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 190 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 189. Current term is 190. Ops: [189.14425-189.14425]
I20260615 08:08:29.483251 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 187.14424, Next index: 14425, Last known committed idx: 14424, Time since last communication: 0.000s
I20260615 08:08:29.510751 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 190 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 189. Current term is 190. Ops: [189.14425-189.14425]
I20260615 08:08:29.511039 13522 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 187.14424, Next index: 14425, Last known committed idx: 14424, Time since last communication: 0.000s
I20260615 08:08:29.511520 13696 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 190 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:29.511560 13696 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 190 FOLLOWER]: Advancing to term 191
I20260615 08:08:29.512104 13696 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 191 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.512241 13696 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 191 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:29.512348 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 191 candidate_status { last_received { term: 187 index: 14424 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:29.512403 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 191 candidate_status { last_received { term: 187 index: 14424 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:29.512591 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 191 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:29.512717 13696 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 191 FOLLOWER]: Leader election lost for term 191. Reason: could not achieve majority
I20260615 08:08:29.521096 13689 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 189 LEADER]: Stepping down as leader of term 189
I20260615 08:08:29.521169 13689 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 189 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:29.521231 13689 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14425, Committed index: 14425, Last appended: 189.14425, Last appended by leader: 14425, Current term: 189, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.521323 13689 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 189 FOLLOWER]: Advancing to term 190
I20260615 08:08:29.527741 13497 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 189 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:29.527807 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 189 FOLLOWER]: Advancing to term 190
I20260615 08:08:29.528259 13497 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 190 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.528415 13497 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 190 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:29.528568 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 190 candidate_status { last_received { term: 189 index: 14425 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:29.528584 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 190 candidate_status { last_received { term: 189 index: 14425 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:29.528672 13401 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 191 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 190. Current term is 191.
I20260615 08:08:29.528825 13213 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 190 election: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 191 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 190. Current term is 191.
I20260615 08:08:29.528872 13213 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 190 election: Cancelling election due to peer responding with higher term
I20260615 08:08:29.528924 13497 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 190 FOLLOWER]: Advancing to term 191
I20260615 08:08:29.529220 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 190 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 190.
I20260615 08:08:29.529515 13497 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 191 FOLLOWER]: Leader election lost for term 190. Reason: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 191 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 190. Current term is 191.
I20260615 08:08:29.546172 13696 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 191 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:29.546226 13696 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 191 FOLLOWER]: Advancing to term 192
I20260615 08:08:29.546805 13696 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 192 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.546967 13696 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 192 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:29.547196 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 192 candidate_status { last_received { term: 187 index: 14424 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:29.547271 13249 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 191 FOLLOWER]: Advancing to term 192
I20260615 08:08:29.547245 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 192 candidate_status { last_received { term: 187 index: 14424 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:29.547327 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 190 FOLLOWER]: Advancing to term 192
I20260615 08:08:29.547823 13249 raft_consensus.cc:2410] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 192 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for term 192 because replica has last-logged OpId of term: 189 index: 14425, which is greater than that of the candidate, which has last-logged OpId of term: 187 index: 14424.
I20260615 08:08:29.547833 13325 raft_consensus.cc:2410] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 192 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for term 192 because replica has last-logged OpId of term: 189 index: 14425, which is greater than that of the candidate, which has last-logged OpId of term: 187 index: 14424.
I20260615 08:08:29.548056 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 192 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:29.548137 13696 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 192 FOLLOWER]: Leader election lost for term 192. Reason: could not achieve majority
I20260615 08:08:29.560168 13580 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 192 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:29.560232 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 192 FOLLOWER]: Advancing to term 193
I20260615 08:08:29.560650 13580 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 193 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.560774 13580 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 193 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:29.560928 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 193 candidate_status { last_received { term: 189 index: 14425 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:29.560983 13249 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 192 FOLLOWER]: Advancing to term 193
I20260615 08:08:29.560945 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 193 candidate_status { last_received { term: 189 index: 14425 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:29.561015 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 192 FOLLOWER]: Advancing to term 193
I20260615 08:08:29.561480 13401 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 193 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 193.
I20260615 08:08:29.561486 13249 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 193 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 193.
I20260615 08:08:29.561702 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 193 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f; no voters:
I20260615 08:08:29.561805 13580 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 193 FOLLOWER]: Leader election won for term 193
I20260615 08:08:29.561861 13580 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 193 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:29.561911 13580 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14425, Committed index: 14425, Last appended: 189.14425, Last appended by leader: 14425, Current term: 193, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.562352 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 189 to 193. New cstate: current_term: 193 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
W20260615 08:08:29.562916 13689 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 190 current term: 193 is higher.
I20260615 08:08:29.584429 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 193 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 187 index: 14424. Preceding OpId from leader: term: 193 index: 14426. (index mismatch)
I20260615 08:08:29.584646 13580 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14426, Last known committed idx: 14424, Time since last communication: 0.000s
I20260615 08:08:29.587908 13249 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 193 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 189 index: 14425. Preceding OpId from leader: term: 193 index: 14426. (index mismatch)
I20260615 08:08:29.588141 13580 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14426, Last known committed idx: 14425, Time since last communication: 0.000s
W20260615 08:08:29.595122 13689 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 190 current term: 193 is higher.
I20260615 08:08:29.644903 13696 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 193 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:29.644997 13696 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 193 FOLLOWER]: Advancing to term 194
I20260615 08:08:29.645783 13696 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 194 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.645978 13696 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 194 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:29.646027 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 194 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 193. Current term is 194. Ops: []
I20260615 08:08:29.646133 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 194 candidate_status { last_received { term: 193 index: 14426 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:29.646133 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 194 candidate_status { last_received { term: 193 index: 14426 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:29.646222 13689 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 193.14426, Next index: 14427, Last known committed idx: 14426, Time since last communication: 0.000s
I20260615 08:08:29.646368 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 194 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:29.646469 13696 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 194 FOLLOWER]: Leader election lost for term 194. Reason: could not achieve majority
I20260615 08:08:29.656459 13580 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 193 LEADER]: Stepping down as leader of term 193
I20260615 08:08:29.656530 13580 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 193 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:29.656605 13580 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14426, Committed index: 14426, Last appended: 193.14426, Last appended by leader: 14426, Current term: 193, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.656723 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 193 FOLLOWER]: Advancing to term 194
I20260615 08:08:29.671684 13468 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 193 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:29.671738 13468 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 193 FOLLOWER]: Advancing to term 194
I20260615 08:08:29.672302 13468 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 194 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.672446 13468 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 194 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:29.672627 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 194 candidate_status { last_received { term: 193 index: 14426 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:29.672627 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 194 candidate_status { last_received { term: 193 index: 14426 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:29.672726 13401 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 194 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 in current term 194: Already voted for candidate b97b73a5f2ad444eb230680e3c3fcb6c in this term.
I20260615 08:08:29.673220 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 194 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 194.
I20260615 08:08:29.673434 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 194 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters: b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:29.673535 13468 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 194 FOLLOWER]: Leader election won for term 194
I20260615 08:08:29.673600 13468 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 194 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:29.673650 13468 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14426, Committed index: 14426, Last appended: 193.14426, Last appended by leader: 14426, Current term: 194, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.674041 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 193 to 194, leader changed from d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194) to 666bbeda390e4798abb1630585e244a1 (127.4.42.193). New cstate: current_term: 194 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:29.685823 13696 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 194 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:29.685879 13696 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 194 FOLLOWER]: Advancing to term 195
I20260615 08:08:29.686321 13696 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 195 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.686458 13696 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 195 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:29.686610 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 195 candidate_status { last_received { term: 193 index: 14426 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:29.686650 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 195 candidate_status { last_received { term: 193 index: 14426 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:29.686738 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 194 FOLLOWER]: Advancing to term 195
I20260615 08:08:29.687227 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 195 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 195.
I20260615 08:08:29.687454 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 195 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1
I20260615 08:08:29.687582 13696 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 195 FOLLOWER]: Leader election won for term 195
I20260615 08:08:29.687646 13696 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 195 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:29.687690 13696 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14426, Committed index: 14426, Last appended: 193.14426, Last appended by leader: 14426, Current term: 195, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.701259 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 195 LEADER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 194. Current term is 195. Ops: []
I20260615 08:08:29.701275 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 195 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 194. Current term is 195. Ops: []
I20260615 08:08:29.701479 13497 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14427, Last known committed idx: 14426, Time since last communication: 0.000s
I20260615 08:08:29.701588 13497 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer b97b73a5f2ad444eb230680e3c3fcb6c log is divergent from this leader: its last log entry 195.14427 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14426
I20260615 08:08:29.701639 13468 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14427, Last known committed idx: 14426, Time since last communication: 0.000s
I20260615 08:08:29.702711 13588 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 194 LEADER]: Stepping down as leader of term 194
I20260615 08:08:29.702733 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 194 to 195, leader changed from 666bbeda390e4798abb1630585e244a1 (127.4.42.193) to b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195). New cstate: current_term: 195 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:29.702814 13588 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 194 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:29.702896 13588 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14426, Committed index: 14426, Last appended: 194.14427, Last appended by leader: 14427, Current term: 194, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.702970 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 194 FOLLOWER]: Advancing to term 195
I20260615 08:08:29.715310 13249 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 195 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 194 index: 14427. Preceding OpId from leader: term: 195 index: 14427. (term mismatch)
I20260615 08:08:29.715473 13249 pending_rounds.cc:85] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1: Aborting all ops after (but not including) 14426
I20260615 08:08:29.715498 13249 pending_rounds.cc:107] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1: Aborting uncommitted NO_OP operation due to leader change: 194.14427
I20260615 08:08:29.715533 13249 raft_consensus.cc:2889] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 195 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260615 08:08:29.715757 13696 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14427, Last known committed idx: 14426, Time since last communication: 0.000s
I20260615 08:08:29.721329 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 195 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 193 index: 14426. Preceding OpId from leader: term: 195 index: 14427. (index mismatch)
I20260615 08:08:29.721566 13696 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14427, Last known committed idx: 14426, Time since last communication: 0.000s
I20260615 08:08:29.775378 13580 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 195 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:29.775447 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 195 FOLLOWER]: Advancing to term 196
I20260615 08:08:29.775986 13580 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 196 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.776139 13580 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 196 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:29.776309 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 196 candidate_status { last_received { term: 195 index: 14427 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:29.776316 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 196 candidate_status { last_received { term: 195 index: 14427 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:29.776437 13249 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 195 FOLLOWER]: Advancing to term 196
I20260615 08:08:29.777084 13249 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 196 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 196.
I20260615 08:08:29.777119 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 196 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 195. Current term is 196. Ops: []
I20260615 08:08:29.777175 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 196 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:29.777230 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 196 FOLLOWER]: Advancing to term 197
I20260615 08:08:29.777275 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 196 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters: b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:29.777287 13669 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 195.14427, Next index: 14428, Last known committed idx: 14427, Time since last communication: 0.000s
I20260615 08:08:29.777392 13580 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 196 FOLLOWER]: Leader election won for term 196
I20260615 08:08:29.777475 13580 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 196 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:29.777522 13580 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14427, Committed index: 14427, Last appended: 195.14427, Last appended by leader: 14427, Current term: 196, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.777937 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 197 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.777948 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 195 to 196, leader changed from b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195) to d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194). New cstate: current_term: 196 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:29.778079 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 197 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:29.778261 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 197 candidate_status { last_received { term: 195 index: 14427 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:29.778314 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 197 candidate_status { last_received { term: 195 index: 14427 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:29.778476 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 197 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:29.778590 13588 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 197 FOLLOWER]: Leader election lost for term 197. Reason: could not achieve majority
I20260615 08:08:29.782511 13249 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 197 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 195. Current term is 197. Ops: []
I20260615 08:08:29.782704 13654 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 195.14427, Next index: 14428, Last known committed idx: 14427, Time since last communication: 0.000s
I20260615 08:08:29.785934 13696 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 195 LEADER]: Stepping down as leader of term 195
I20260615 08:08:29.785976 13696 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 195 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:29.786043 13696 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14427, Committed index: 14427, Last appended: 195.14427, Last appended by leader: 14427, Current term: 195, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.786147 13696 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 195 FOLLOWER]: Advancing to term 196
I20260615 08:08:29.802320 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 196 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 195 index: 14427. Preceding OpId from leader: term: 196 index: 14428. (index mismatch)
I20260615 08:08:29.802587 13580 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14428, Last known committed idx: 14427, Time since last communication: 0.000s
I20260615 08:08:29.808894 13249 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 197 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 196. Current term is 197. Ops: []
I20260615 08:08:29.809146 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14428, Last known committed idx: 14427, Time since last communication: 0.000s
I20260615 08:08:29.811884 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 197 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:29.811925 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 197 FOLLOWER]: Advancing to term 198
I20260615 08:08:29.812400 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 198 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.812533 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 198 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:29.812651 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 198 candidate_status { last_received { term: 195 index: 14427 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:29.812666 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 198 candidate_status { last_received { term: 195 index: 14427 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:29.812929 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 198 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:29.813026 13588 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 198 FOLLOWER]: Leader election lost for term 198. Reason: could not achieve majority
I20260615 08:08:29.829522 13249 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 198 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 196. Current term is 198. Ops: [196.14428-196.14428]
I20260615 08:08:29.829737 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 195.14427, Next index: 14428, Last known committed idx: 14427, Time since last communication: 0.000s
I20260615 08:08:29.833498 13696 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 196 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:29.833536 13696 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 196 FOLLOWER]: Advancing to term 197
I20260615 08:08:29.834012 13696 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 197 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.834106 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 197 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 196. Current term is 197. Ops: []
I20260615 08:08:29.834263 13696 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 197 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:29.834254 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 197 candidate_status { last_received { term: 196 index: 14428 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:29.834337 13522 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 196.14428, Next index: 14429, Last known committed idx: 14428, Time since last communication: 0.000s
I20260615 08:08:29.834254 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 197 candidate_status { last_received { term: 196 index: 14428 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:29.834510 13249 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 198 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 197. Current term is 198.
I20260615 08:08:29.834625 13364 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 197 election: Vote denied by peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 198 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 197. Current term is 198.
I20260615 08:08:29.834681 13364 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 197 election: Cancelling election due to peer responding with higher term
I20260615 08:08:29.834733 13696 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 197 FOLLOWER]: Advancing to term 198
I20260615 08:08:29.835153 13696 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 198 FOLLOWER]: Leader election lost for term 197. Reason: Vote denied by peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 198 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 197. Current term is 198.
I20260615 08:08:29.856441 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 198 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:29.856503 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 198 FOLLOWER]: Advancing to term 199
I20260615 08:08:29.857071 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 199 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.857224 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 199 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:29.857450 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 199 candidate_status { last_received { term: 195 index: 14427 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:29.857461 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 199 candidate_status { last_received { term: 195 index: 14427 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:29.857577 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 198 FOLLOWER]: Advancing to term 199
I20260615 08:08:29.858079 13401 raft_consensus.cc:2410] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 199 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for term 199 because replica has last-logged OpId of term: 196 index: 14428, which is greater than that of the candidate, which has last-logged OpId of term: 195 index: 14427.
I20260615 08:08:29.858278 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 199 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:29.858374 13588 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 199 FOLLOWER]: Leader election lost for term 199. Reason: could not achieve majority
I20260615 08:08:29.863009 13249 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 199 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 196. Current term is 199. Ops: [196.14428-196.14428]
I20260615 08:08:29.863240 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 195.14427, Next index: 14428, Last known committed idx: 14427, Time since last communication: 0.000s
I20260615 08:08:29.864538 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 199 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 196. Current term is 199. Ops: []
I20260615 08:08:29.864758 13522 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 196.14428, Next index: 14429, Last known committed idx: 14428, Time since last communication: 0.000s
I20260615 08:08:29.877655 13696 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 199 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:29.877743 13696 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 199 FOLLOWER]: Advancing to term 200
I20260615 08:08:29.878257 13696 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 200 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.878403 13696 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 200 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:29.878582 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 200 candidate_status { last_received { term: 196 index: 14428 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:29.878615 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 200 candidate_status { last_received { term: 196 index: 14428 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:29.878674 13249 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 199 FOLLOWER]: Advancing to term 200
I20260615 08:08:29.879221 13249 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 200 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 200.
I20260615 08:08:29.879405 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 200 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters: d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:29.879493 13696 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 200 FOLLOWER]: Leader election won for term 200
I20260615 08:08:29.879549 13696 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 200 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:29.879627 13696 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14428, Committed index: 14428, Last appended: 196.14428, Last appended by leader: 14428, Current term: 200, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.880045 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 196 to 200, leader changed from d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194) to b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195). New cstate: current_term: 200 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:29.884533 13689 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 196 LEADER]: Stepping down as leader of term 196
I20260615 08:08:29.884586 13689 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 196 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:29.884655 13689 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14428, Committed index: 14428, Last appended: 196.14428, Last appended by leader: 14428, Current term: 196, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.884743 13689 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 196 FOLLOWER]: Advancing to term 197
I20260615 08:08:29.904299 13249 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 200 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 195 index: 14427. Preceding OpId from leader: term: 200 index: 14429. (index mismatch)
I20260615 08:08:29.904590 13696 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14429, Last known committed idx: 14427, Time since last communication: 0.000s
I20260615 08:08:29.905831 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 197 FOLLOWER]: Advancing to term 200
I20260615 08:08:29.906585 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 200 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 196 index: 14428. Preceding OpId from leader: term: 200 index: 14429. (index mismatch)
I20260615 08:08:29.906816 13696 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14429, Last known committed idx: 14428, Time since last communication: 0.000s
W20260615 08:08:29.907039 13459 lock_manager.cc:494] Txn 8 has not acquired the partition lock after 1000ms
I20260615 08:08:29.938977 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 200 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:29.939085 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 200 FOLLOWER]: Advancing to term 201
I20260615 08:08:29.939908 13689 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 200 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:29.939973 13689 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 200 FOLLOWER]: Advancing to term 201
I20260615 08:08:29.939965 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 201 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.940116 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 201 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:29.940321 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 201 candidate_status { last_received { term: 200 index: 14430 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:29.940623 13249 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 201 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 200. Current term is 201. Ops: []
I20260615 08:08:29.940815 13669 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 200.14430, Next index: 14431, Last known committed idx: 14430, Time since last communication: 0.000s
I20260615 08:08:29.940815 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 201 candidate_status { last_received { term: 200 index: 14430 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:29.940935 13689 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 201 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.941017 13325 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 201 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 in current term 201: Already voted for candidate d4d7c2ebbf334b19a7f964aab04f280f in this term.
I20260615 08:08:29.941059 13689 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 201 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:29.941146 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 201 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:29.941223 13588 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 201 FOLLOWER]: Leader election lost for term 201. Reason: could not achieve majority
I20260615 08:08:29.941359 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 201 candidate_status { last_received { term: 200 index: 14430 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:29.941365 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 201 candidate_status { last_received { term: 200 index: 14430 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:29.941439 13249 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 201 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f in current term 201: Already voted for candidate 666bbeda390e4798abb1630585e244a1 in this term.
I20260615 08:08:29.941581 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 201 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:29.941674 13689 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 201 FOLLOWER]: Leader election lost for term 201. Reason: could not achieve majority
I20260615 08:08:29.945495 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 201 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 200. Current term is 201. Ops: []
I20260615 08:08:29.945703 13654 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 200.14430, Next index: 14431, Last known committed idx: 14430, Time since last communication: 0.000s
I20260615 08:08:29.975272 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 201 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 200. Current term is 201. Ops: []
I20260615 08:08:29.975536 13669 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 200.14430, Next index: 14431, Last known committed idx: 14430, Time since last communication: 0.000s
I20260615 08:08:29.975680 13249 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 201 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 200. Current term is 201. Ops: []
I20260615 08:08:29.975873 13654 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 200.14430, Next index: 14431, Last known committed idx: 14430, Time since last communication: 0.000s
I20260615 08:08:29.977566 13689 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 201 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:29.977626 13689 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 201 FOLLOWER]: Advancing to term 202
I20260615 08:08:29.977813 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 201 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:29.977861 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 201 FOLLOWER]: Advancing to term 202
I20260615 08:08:29.978296 13689 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 202 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.978437 13689 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 202 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:29.978456 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 202 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:29.978561 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 202 candidate_status { last_received { term: 200 index: 14430 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:29.978608 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 202 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:29.978634 13249 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 202 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f in current term 202: Already voted for candidate 666bbeda390e4798abb1630585e244a1 in this term.
I20260615 08:08:29.978762 13400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 202 candidate_status { last_received { term: 200 index: 14430 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:29.978833 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 202 candidate_status { last_received { term: 200 index: 14430 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:29.978737 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 202 candidate_status { last_received { term: 200 index: 14430 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:29.978904 13325 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 202 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 in current term 202: Already voted for candidate d4d7c2ebbf334b19a7f964aab04f280f in this term.
I20260615 08:08:29.979003 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 202 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:29.979017 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 202 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:29.979110 13689 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 202 FOLLOWER]: Leader election lost for term 202. Reason: could not achieve majority
I20260615 08:08:29.979131 13588 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 202 FOLLOWER]: Leader election lost for term 202. Reason: could not achieve majority
I20260615 08:08:29.998903 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 202 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 200. Current term is 202. Ops: []
I20260615 08:08:29.999153 13654 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 200.14430, Next index: 14431, Last known committed idx: 14430, Time since last communication: 0.000s
I20260615 08:08:30.001493 13249 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 202 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 200. Current term is 202. Ops: []
I20260615 08:08:30.001750 13669 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 200.14430, Next index: 14431, Last known committed idx: 14430, Time since last communication: 0.000s
I20260615 08:08:30.021335 13696 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 200 LEADER]: Stepping down as leader of term 200
I20260615 08:08:30.021387 13696 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 200 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:30.021464 13696 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14430, Committed index: 14430, Last appended: 200.14430, Last appended by leader: 14430, Current term: 200, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.021570 13696 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 200 FOLLOWER]: Advancing to term 201
I20260615 08:08:30.023537 13689 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 202 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:30.023590 13689 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 202 FOLLOWER]: Advancing to term 203
I20260615 08:08:30.024111 13689 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 203 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.024258 13689 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 203 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:30.024468 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 203 candidate_status { last_received { term: 200 index: 14430 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:30.024490 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 203 candidate_status { last_received { term: 200 index: 14430 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:30.024551 13249 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 202 FOLLOWER]: Advancing to term 203
I20260615 08:08:30.024561 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 201 FOLLOWER]: Advancing to term 203
I20260615 08:08:30.025167 13249 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 203 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 203.
I20260615 08:08:30.025167 13401 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 203 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 203.
I20260615 08:08:30.025379 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 203 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters:
I20260615 08:08:30.025462 13689 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 203 FOLLOWER]: Leader election won for term 203
I20260615 08:08:30.025513 13689 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 203 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:30.025559 13689 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14430, Committed index: 14430, Last appended: 200.14430, Last appended by leader: 14430, Current term: 203, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.025985 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 200 to 203, leader changed from b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195) to d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194). New cstate: current_term: 203 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:30.060228 13249 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 203 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 200 index: 14430. Preceding OpId from leader: term: 203 index: 14431. (index mismatch)
I20260615 08:08:30.060228 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 203 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 200 index: 14430. Preceding OpId from leader: term: 203 index: 14431. (index mismatch)
I20260615 08:08:30.060544 13580 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14431, Last known committed idx: 14430, Time since last communication: 0.000s
I20260615 08:08:30.060664 13689 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14431, Last known committed idx: 14430, Time since last communication: 0.000s
I20260615 08:08:30.092343 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 203 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:30.092422 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 203 FOLLOWER]: Advancing to term 204
I20260615 08:08:30.093022 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 204 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.093173 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 204 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:30.093366 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 204 candidate_status { last_received { term: 203 index: 14431 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:30.093366 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 204 candidate_status { last_received { term: 203 index: 14431 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:30.093637 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 204 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:30.093762 13588 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 204 FOLLOWER]: Leader election lost for term 204. Reason: could not achieve majority
I20260615 08:08:30.094013 13249 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 204 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 203. Current term is 204. Ops: []
I20260615 08:08:30.094215 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 203.14431, Next index: 14432, Last known committed idx: 14431, Time since last communication: 0.000s
I20260615 08:08:30.117758 13249 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 204 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 203. Current term is 204. Ops: []
I20260615 08:08:30.118001 13689 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 203.14431, Next index: 14432, Last known committed idx: 14431, Time since last communication: 0.000s
I20260615 08:08:30.122172 13654 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 203 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:30.122211 13654 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 203 FOLLOWER]: Advancing to term 204
I20260615 08:08:30.122939 13654 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 204 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.123098 13654 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 204 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:30.123226 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 204 candidate_status { last_received { term: 203 index: 14431 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:30.123310 13249 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 204 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c in current term 204: Already voted for candidate 666bbeda390e4798abb1630585e244a1 in this term.
I20260615 08:08:30.123277 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 204 candidate_status { last_received { term: 203 index: 14431 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:30.123502 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 204 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:30.123625 13654 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 204 FOLLOWER]: Leader election lost for term 204. Reason: could not achieve majority
I20260615 08:08:30.125420 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 204 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 203. Current term is 204. Ops: []
I20260615 08:08:30.125640 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 203.14431, Next index: 14432, Last known committed idx: 14431, Time since last communication: 0.000s
I20260615 08:08:30.137632 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 204 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:30.137694 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 204 FOLLOWER]: Advancing to term 205
I20260615 08:08:30.138293 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 205 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.138448 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 205 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:30.138645 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 205 candidate_status { last_received { term: 203 index: 14431 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:30.138674 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 205 candidate_status { last_received { term: 203 index: 14431 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:30.138779 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 204 FOLLOWER]: Advancing to term 205
I20260615 08:08:30.139390 13401 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 205 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 205.
I20260615 08:08:30.139604 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 205 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters: d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:30.139751 13588 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 205 FOLLOWER]: Leader election won for term 205
I20260615 08:08:30.139823 13588 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 205 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:30.139880 13588 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14431, Committed index: 14431, Last appended: 203.14431, Last appended by leader: 14431, Current term: 205, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.140348 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 203 to 205, leader changed from d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194) to 666bbeda390e4798abb1630585e244a1 (127.4.42.193). New cstate: current_term: 205 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:30.143030 13249 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 205 LEADER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 203. Current term is 205. Ops: []
I20260615 08:08:30.143278 13689 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 203.14431, Next index: 14432, Last known committed idx: 14431, Time since last communication: 0.000s
I20260615 08:08:30.143380 13689 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer 666bbeda390e4798abb1630585e244a1 log is divergent from this leader: its last log entry 205.14432 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14431
I20260615 08:08:30.148682 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 205 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 203. Current term is 205. Ops: []
I20260615 08:08:30.148912 13689 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 203.14431, Next index: 14432, Last known committed idx: 14431, Time since last communication: 0.000s
I20260615 08:08:30.163758 13522 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 203 LEADER]: Stepping down as leader of term 203
I20260615 08:08:30.163820 13522 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 203 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:30.163924 13522 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14431, Committed index: 14431, Last appended: 203.14431, Last appended by leader: 14431, Current term: 203, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.164013 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 203 FOLLOWER]: Advancing to term 204
I20260615 08:08:30.170853 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 205 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 203 index: 14431. Preceding OpId from leader: term: 205 index: 14432. (index mismatch)
I20260615 08:08:30.171137 13588 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14432, Last known committed idx: 14431, Time since last communication: 0.000s
I20260615 08:08:30.176498 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 204 FOLLOWER]: Advancing to term 205
I20260615 08:08:30.177208 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 205 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 203 index: 14431. Preceding OpId from leader: term: 205 index: 14432. (index mismatch)
I20260615 08:08:30.177480 13468 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14432, Last known committed idx: 14431, Time since last communication: 0.000s
I20260615 08:08:30.262158 13689 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 205 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:30.262259 13689 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 205 FOLLOWER]: Advancing to term 206
I20260615 08:08:30.262899 13689 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 206 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.263072 13689 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 206 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:30.263226 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 206 candidate_status { last_received { term: 205 index: 14432 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:30.263243 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 206 candidate_status { last_received { term: 205 index: 14432 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:30.263461 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 206 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:30.263542 13689 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 206 FOLLOWER]: Leader election lost for term 206. Reason: could not achieve majority
I20260615 08:08:30.265628 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 206 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 205. Current term is 206. Ops: []
I20260615 08:08:30.265935 13497 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 205.14432, Next index: 14433, Last known committed idx: 14432, Time since last communication: 0.000s
I20260615 08:08:30.300796 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 206 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 205. Current term is 206. Ops: []
I20260615 08:08:30.301091 13497 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 205.14432, Next index: 14433, Last known committed idx: 14432, Time since last communication: 0.000s
I20260615 08:08:30.304008 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 206 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:30.304078 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 206 FOLLOWER]: Advancing to term 207
I20260615 08:08:30.304658 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 207 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.304806 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 207 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:30.305006 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 207 candidate_status { last_received { term: 205 index: 14432 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:30.305006 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 207 candidate_status { last_received { term: 205 index: 14432 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:30.305234 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 207 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:30.305331 13522 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 207 FOLLOWER]: Leader election lost for term 207. Reason: could not achieve majority
I20260615 08:08:30.318406 13588 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 205 LEADER]: Stepping down as leader of term 205
I20260615 08:08:30.318462 13588 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 205 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:30.318559 13588 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14432, Committed index: 14432, Last appended: 205.14432, Last appended by leader: 14432, Current term: 205, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.318657 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 205 FOLLOWER]: Advancing to term 206
I20260615 08:08:30.338785 13696 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 205 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:30.338855 13696 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 205 FOLLOWER]: Advancing to term 206
I20260615 08:08:30.339540 13696 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 206 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.339731 13696 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 206 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:30.339934 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 206 candidate_status { last_received { term: 205 index: 14432 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:30.339934 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 206 candidate_status { last_received { term: 205 index: 14432 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:30.340042 13325 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 207 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 206. Current term is 207.
I20260615 08:08:30.340214 13366 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 206 election: Vote denied by peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 207 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 206. Current term is 207.
I20260615 08:08:30.340287 13366 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 206 election: Cancelling election due to peer responding with higher term
I20260615 08:08:30.340350 13696 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 206 FOLLOWER]: Advancing to term 207
I20260615 08:08:30.340622 13249 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 206 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 206.
I20260615 08:08:30.340941 13696 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 207 FOLLOWER]: Leader election lost for term 206. Reason: Vote denied by peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 207 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 206. Current term is 207.
I20260615 08:08:30.357590 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 207 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:30.357666 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 207 FOLLOWER]: Advancing to term 208
I20260615 08:08:30.358212 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 208 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.358348 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 208 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:30.358616 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 208 candidate_status { last_received { term: 205 index: 14432 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:30.358698 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 208 candidate_status { last_received { term: 205 index: 14432 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:30.358784 13249 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 206 FOLLOWER]: Advancing to term 208
I20260615 08:08:30.358808 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 207 FOLLOWER]: Advancing to term 208
I20260615 08:08:30.359333 13249 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 208 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 208.
I20260615 08:08:30.359339 13401 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 208 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 208.
I20260615 08:08:30.359543 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 208 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters:
I20260615 08:08:30.359630 13522 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 208 FOLLOWER]: Leader election won for term 208
I20260615 08:08:30.359687 13522 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 208 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:30.359743 13522 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14432, Committed index: 14432, Last appended: 205.14432, Last appended by leader: 14432, Current term: 208, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.360168 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 205 to 208, leader changed from 666bbeda390e4798abb1630585e244a1 (127.4.42.193) to d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194). New cstate: current_term: 208 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:30.383455 13249 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 208 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 205 index: 14432. Preceding OpId from leader: term: 208 index: 14433. (index mismatch)
I20260615 08:08:30.383468 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 208 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 205 index: 14432. Preceding OpId from leader: term: 208 index: 14433. (index mismatch)
I20260615 08:08:30.383752 13522 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14433, Last known committed idx: 14432, Time since last communication: 0.000s
I20260615 08:08:30.383852 13689 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14433, Last known committed idx: 14432, Time since last communication: 0.000s
I20260615 08:08:30.414814 13696 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 208 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:30.414909 13696 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 208 FOLLOWER]: Advancing to term 209
I20260615 08:08:30.415536 13696 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 209 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.415686 13696 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 209 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:30.415825 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 209 candidate_status { last_received { term: 208 index: 14433 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:30.415843 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 209 candidate_status { last_received { term: 208 index: 14433 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:30.416071 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 209 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:30.416158 13696 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 209 FOLLOWER]: Leader election lost for term 209. Reason: could not achieve majority
I20260615 08:08:30.418346 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 209 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 208. Current term is 209. Ops: []
I20260615 08:08:30.418582 13689 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 208.14433, Next index: 14434, Last known committed idx: 14433, Time since last communication: 0.000s
I20260615 08:08:30.443490 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 208 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:30.443569 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 208 FOLLOWER]: Advancing to term 209
I20260615 08:08:30.444109 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 209 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.444244 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 209 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:30.444389 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 209 candidate_status { last_received { term: 208 index: 14433 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:30.444547 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 209 candidate_status { last_received { term: 208 index: 14433 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:30.444613 13401 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 209 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 in current term 209: Already voted for candidate b97b73a5f2ad444eb230680e3c3fcb6c in this term.
I20260615 08:08:30.444764 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 209 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:30.444887 13588 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 209 FOLLOWER]: Leader election lost for term 209. Reason: could not achieve majority
I20260615 08:08:30.448035 13249 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 209 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 208. Current term is 209. Ops: []
I20260615 08:08:30.448263 13689 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 208.14433, Next index: 14434, Last known committed idx: 14433, Time since last communication: 0.000s
I20260615 08:08:30.450466 13696 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 209 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:30.450533 13696 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 209 FOLLOWER]: Advancing to term 210
I20260615 08:08:30.451007 13696 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 210 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.451144 13696 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 210 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:30.451274 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 210 candidate_status { last_received { term: 208 index: 14433 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:30.451308 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 210 candidate_status { last_received { term: 208 index: 14433 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:30.451335 13249 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 209 FOLLOWER]: Advancing to term 210
I20260615 08:08:30.451938 13249 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 210 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 210.
I20260615 08:08:30.452104 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 210 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters: d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:30.452203 13696 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 210 FOLLOWER]: Leader election won for term 210
I20260615 08:08:30.452252 13696 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 210 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:30.452302 13696 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14433, Committed index: 14433, Last appended: 208.14433, Last appended by leader: 14433, Current term: 210, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.452692 13146 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 208 to 210, leader changed from d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194) to b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195). New cstate: current_term: 210 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:30.453858 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 210 LEADER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 208. Current term is 210. Ops: []
I20260615 08:08:30.454028 13689 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 208.14433, Next index: 14434, Last known committed idx: 14433, Time since last communication: 0.000s
I20260615 08:08:30.454140 13689 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer b97b73a5f2ad444eb230680e3c3fcb6c log is divergent from this leader: its last log entry 210.14434 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14433
I20260615 08:08:30.475437 13325 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 208 LEADER]: Stepping down as leader of term 208
I20260615 08:08:30.475500 13325 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 208 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:30.475557 13325 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14433, Committed index: 14433, Last appended: 208.14433, Last appended by leader: 14433, Current term: 208, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.475647 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 208 FOLLOWER]: Advancing to term 210
I20260615 08:08:30.476172 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 210 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 208 index: 14433. Preceding OpId from leader: term: 210 index: 14434. (index mismatch)
I20260615 08:08:30.476404 13696 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14434, Last known committed idx: 14433, Time since last communication: 0.000s
I20260615 08:08:30.484409 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 210 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:30.484467 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 210 FOLLOWER]: Advancing to term 211
I20260615 08:08:30.484953 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 211 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.485090 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 211 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:30.485242 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 211 candidate_status { last_received { term: 208 index: 14433 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:30.485314 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 211 candidate_status { last_received { term: 208 index: 14433 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:30.485538 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 211 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:30.485639 13588 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 211 FOLLOWER]: Leader election lost for term 211. Reason: could not achieve majority
I20260615 08:08:30.488730 13249 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 211 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 210. Current term is 211. Ops: []
I20260615 08:08:30.488907 13696 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14434, Last known committed idx: 14433, Time since last communication: 0.000s
I20260615 08:08:30.512506 13249 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 211 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 210. Current term is 211. Ops: [210.14434-210.14434]
I20260615 08:08:30.512738 13654 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 208.14433, Next index: 14434, Last known committed idx: 14433, Time since last communication: 0.000s
I20260615 08:08:30.515926 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 211 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:30.515973 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 211 FOLLOWER]: Advancing to term 212
I20260615 08:08:30.516521 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 212 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.516661 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 212 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:30.516811 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 212 candidate_status { last_received { term: 208 index: 14433 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:30.516885 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 212 candidate_status { last_received { term: 208 index: 14433 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:30.517069 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 212 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:30.517163 13588 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 212 FOLLOWER]: Leader election lost for term 212. Reason: could not achieve majority
I20260615 08:08:30.537006 13249 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 212 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 210. Current term is 212. Ops: [210.14434-210.14434]
I20260615 08:08:30.537235 13696 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 208.14433, Next index: 14434, Last known committed idx: 14433, Time since last communication: 0.000s
I20260615 08:08:30.549546 13669 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 210 LEADER]: Stepping down as leader of term 210
I20260615 08:08:30.549595 13669 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 210 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:30.549660 13669 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14434, Committed index: 14434, Last appended: 210.14434, Last appended by leader: 14434, Current term: 210, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.549736 13669 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 210 FOLLOWER]: Advancing to term 211
I20260615 08:08:30.564216 13689 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 210 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:30.564265 13689 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 210 FOLLOWER]: Advancing to term 211
I20260615 08:08:30.564731 13689 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 211 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.564851 13689 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 211 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:30.565026 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 211 candidate_status { last_received { term: 210 index: 14434 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:30.565037 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 211 candidate_status { last_received { term: 210 index: 14434 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:30.565115 13249 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 212 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 211. Current term is 212.
I20260615 08:08:30.565279 13289 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 211 election: Vote denied by peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 212 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 211. Current term is 212.
I20260615 08:08:30.565320 13289 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 211 election: Cancelling election due to peer responding with higher term
I20260615 08:08:30.565382 13689 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 211 FOLLOWER]: Advancing to term 212
I20260615 08:08:30.565728 13401 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 211 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 211.
I20260615 08:08:30.566028 13689 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 212 FOLLOWER]: Leader election lost for term 211. Reason: Vote denied by peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 212 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 211. Current term is 212.
I20260615 08:08:30.570688 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 212 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:30.570739 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 212 FOLLOWER]: Advancing to term 213
I20260615 08:08:30.571266 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 213 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.571429 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 213 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:30.571556 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 213 candidate_status { last_received { term: 208 index: 14433 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:30.571628 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 212 FOLLOWER]: Advancing to term 213
I20260615 08:08:30.571561 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 213 candidate_status { last_received { term: 208 index: 14433 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:30.571679 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 211 FOLLOWER]: Advancing to term 213
I20260615 08:08:30.572171 13325 raft_consensus.cc:2410] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 213 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for term 213 because replica has last-logged OpId of term: 210 index: 14434, which is greater than that of the candidate, which has last-logged OpId of term: 208 index: 14433.
I20260615 08:08:30.572178 13401 raft_consensus.cc:2410] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 213 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for term 213 because replica has last-logged OpId of term: 210 index: 14434, which is greater than that of the candidate, which has last-logged OpId of term: 208 index: 14433.
I20260615 08:08:30.572369 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 213 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:30.572465 13588 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 213 FOLLOWER]: Leader election lost for term 213. Reason: could not achieve majority
I20260615 08:08:30.596583 13689 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 213 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:30.596644 13689 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 213 FOLLOWER]: Advancing to term 214
I20260615 08:08:30.597151 13689 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 214 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.597319 13689 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 214 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:30.597489 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 214 candidate_status { last_received { term: 210 index: 14434 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:30.597563 13249 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 213 FOLLOWER]: Advancing to term 214
I20260615 08:08:30.597523 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 214 candidate_status { last_received { term: 210 index: 14434 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:30.597600 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 213 FOLLOWER]: Advancing to term 214
I20260615 08:08:30.598083 13401 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 214 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 214.
I20260615 08:08:30.598100 13249 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 214 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 214.
I20260615 08:08:30.598289 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 214 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters:
I20260615 08:08:30.598414 13689 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 214 FOLLOWER]: Leader election won for term 214
I20260615 08:08:30.598488 13689 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 214 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:30.598567 13689 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14434, Committed index: 14434, Last appended: 210.14434, Last appended by leader: 14434, Current term: 214, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.599028 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 210 to 214, leader changed from b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195) to d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194). New cstate: current_term: 214 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:30.630167 13249 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 214 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 208 index: 14433. Preceding OpId from leader: term: 214 index: 14435. (index mismatch)
I20260615 08:08:30.630440 13689 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14435, Last known committed idx: 14433, Time since last communication: 0.000s
I20260615 08:08:30.631276 13669 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 214 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:30.631330 13669 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 214 FOLLOWER]: Advancing to term 215
I20260615 08:08:30.631934 13669 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 215 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.632036 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 215 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 214. Current term is 215. Ops: []
I20260615 08:08:30.632109 13669 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 215 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:30.632266 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 215 candidate_status { last_received { term: 210 index: 14434 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:30.632296 13689 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14435, Last known committed idx: 14434, Time since last communication: 0.000s
I20260615 08:08:30.632275 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 215 candidate_status { last_received { term: 210 index: 14434 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:30.632694 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 215 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:30.632774 13669 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 215 FOLLOWER]: Leader election lost for term 215. Reason: could not achieve majority
I20260615 08:08:30.661485 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 215 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 214. Current term is 215. Ops: [214.14435-214.14435]
I20260615 08:08:30.661732 13522 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 210.14434, Next index: 14435, Last known committed idx: 14434, Time since last communication: 0.000s
I20260615 08:08:30.671106 13669 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 215 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:30.671170 13669 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 215 FOLLOWER]: Advancing to term 216
I20260615 08:08:30.671675 13669 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 216 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.671825 13669 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 216 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:30.671964 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 216 candidate_status { last_received { term: 210 index: 14434 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:30.672030 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 216 candidate_status { last_received { term: 210 index: 14434 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:30.672242 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 216 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:30.672341 13669 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 216 FOLLOWER]: Leader election lost for term 216. Reason: could not achieve majority
I20260615 08:08:30.673519 13580 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 214 LEADER]: Stepping down as leader of term 214
I20260615 08:08:30.673568 13580 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 214 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:30.673624 13580 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14435, Committed index: 14435, Last appended: 214.14435, Last appended by leader: 14435, Current term: 214, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.673710 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 214 FOLLOWER]: Advancing to term 215
I20260615 08:08:30.688370 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 214 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:30.688438 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 214 FOLLOWER]: Advancing to term 215
I20260615 08:08:30.688925 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 215 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.689060 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 215 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:30.689211 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 215 candidate_status { last_received { term: 214 index: 14435 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:30.689287 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 215 candidate_status { last_received { term: 214 index: 14435 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:30.689376 13401 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 216 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 215. Current term is 216.
I20260615 08:08:30.689607 13213 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 215 election: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 216 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 215. Current term is 216.
I20260615 08:08:30.689653 13213 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 215 election: Cancelling election due to peer responding with higher term
I20260615 08:08:30.689718 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 215 FOLLOWER]: Advancing to term 216
I20260615 08:08:30.689960 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 215 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 215.
I20260615 08:08:30.690296 13588 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 216 FOLLOWER]: Leader election lost for term 215. Reason: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 216 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 215. Current term is 216.
I20260615 08:08:30.715709 13669 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 216 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:30.715778 13669 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 216 FOLLOWER]: Advancing to term 217
I20260615 08:08:30.716241 13669 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 217 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.716387 13669 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 217 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:30.716526 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 217 candidate_status { last_received { term: 210 index: 14434 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:30.716552 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 217 candidate_status { last_received { term: 210 index: 14434 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:30.716611 13249 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 216 FOLLOWER]: Advancing to term 217
I20260615 08:08:30.716622 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 215 FOLLOWER]: Advancing to term 217
I20260615 08:08:30.717221 13325 raft_consensus.cc:2410] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 217 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for term 217 because replica has last-logged OpId of term: 214 index: 14435, which is greater than that of the candidate, which has last-logged OpId of term: 210 index: 14434.
I20260615 08:08:30.717231 13249 raft_consensus.cc:2410] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 217 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for term 217 because replica has last-logged OpId of term: 214 index: 14435, which is greater than that of the candidate, which has last-logged OpId of term: 210 index: 14434.
I20260615 08:08:30.717448 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 217 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:30.717595 13669 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 217 FOLLOWER]: Leader election lost for term 217. Reason: could not achieve majority
I20260615 08:08:30.723048 13580 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 217 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:30.723129 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 217 FOLLOWER]: Advancing to term 218
I20260615 08:08:30.723570 13580 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 218 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.723706 13580 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 218 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:30.723862 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 218 candidate_status { last_received { term: 214 index: 14435 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:30.723862 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 218 candidate_status { last_received { term: 214 index: 14435 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:30.723945 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 217 FOLLOWER]: Advancing to term 218
I20260615 08:08:30.723955 13249 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 217 FOLLOWER]: Advancing to term 218
I20260615 08:08:30.724499 13249 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 218 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 218.
I20260615 08:08:30.724516 13401 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 218 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 218.
I20260615 08:08:30.724680 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 218 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f; no voters:
I20260615 08:08:30.724772 13580 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 218 FOLLOWER]: Leader election won for term 218
I20260615 08:08:30.724853 13580 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 218 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:30.724922 13580 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14435, Committed index: 14435, Last appended: 214.14435, Last appended by leader: 14435, Current term: 218, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.725335 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 214 to 218. New cstate: current_term: 218 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:30.749639 13249 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 218 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 214 index: 14435. Preceding OpId from leader: term: 218 index: 14436. (index mismatch)
I20260615 08:08:30.749871 13580 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14436, Last known committed idx: 14435, Time since last communication: 0.000s
I20260615 08:08:30.753593 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 218 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 210 index: 14434. Preceding OpId from leader: term: 218 index: 14436. (index mismatch)
I20260615 08:08:30.753851 13580 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14436, Last known committed idx: 14434, Time since last communication: 0.000s
I20260615 08:08:30.781013 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 218 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:30.781117 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 218 FOLLOWER]: Advancing to term 219
I20260615 08:08:30.781773 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 219 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.781924 13249 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 219 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 218. Current term is 219. Ops: []
I20260615 08:08:30.782004 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 219 candidate_status { last_received { term: 218 index: 14436 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:30.782040 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 219 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:30.782086 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 219 candidate_status { last_received { term: 218 index: 14436 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:30.782155 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 218.14436, Next index: 14437, Last known committed idx: 14436, Time since last communication: 0.000s
I20260615 08:08:30.782244 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 219 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:30.782367 13588 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 219 FOLLOWER]: Leader election lost for term 219. Reason: could not achieve majority
I20260615 08:08:30.810838 13249 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 219 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 218. Current term is 219. Ops: []
I20260615 08:08:30.811072 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 218.14436, Next index: 14437, Last known committed idx: 14436, Time since last communication: 0.000s
I20260615 08:08:30.812323 13696 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 218 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:30.812371 13696 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 218 FOLLOWER]: Advancing to term 219
I20260615 08:08:30.812655 13588 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 219 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:30.812703 13588 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 219 FOLLOWER]: Advancing to term 220
I20260615 08:08:30.812997 13696 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 219 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.813119 13696 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 219 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:30.813251 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 219 candidate_status { last_received { term: 218 index: 14436 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:30.813252 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 219 candidate_status { last_received { term: 218 index: 14436 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:30.813503 13588 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 220 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.813598 13249 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 220 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 219. Current term is 220.
I20260615 08:08:30.813697 13588 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 220 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:30.813731 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 220 candidate_status { last_received { term: 218 index: 14436 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:30.813750 13364 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 219 election: Vote denied by peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 220 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 219. Current term is 220.
I20260615 08:08:30.813834 13364 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 219 election: Cancelling election due to peer responding with higher term
I20260615 08:08:30.813731 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 220 candidate_status { last_received { term: 218 index: 14436 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:30.813911 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 219 FOLLOWER]: Advancing to term 220
I20260615 08:08:30.814373 13401 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 220 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 220.
I20260615 08:08:30.814446 13696 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 220 FOLLOWER]: Leader election lost for term 219. Reason: Vote denied by peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 220 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 219. Current term is 220.
I20260615 08:08:30.814567 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 220 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters: d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:30.814668 13588 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 220 FOLLOWER]: Leader election won for term 220
I20260615 08:08:30.814779 13588 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 220 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:30.814817 13588 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14436, Committed index: 14436, Last appended: 218.14436, Last appended by leader: 14436, Current term: 220, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.815188 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 218 to 220, leader changed from d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194) to 666bbeda390e4798abb1630585e244a1 (127.4.42.193). New cstate: current_term: 220 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:30.817027 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 220 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 218. Current term is 220. Ops: []
I20260615 08:08:30.817237 13689 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 218.14436, Next index: 14437, Last known committed idx: 14436, Time since last communication: 0.000s
I20260615 08:08:30.840940 13249 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 220 LEADER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 218. Current term is 220. Ops: []
I20260615 08:08:30.841215 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 218.14436, Next index: 14437, Last known committed idx: 14436, Time since last communication: 0.000s
I20260615 08:08:30.841336 13580 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer 666bbeda390e4798abb1630585e244a1 log is divergent from this leader: its last log entry 220.14437 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14436
I20260615 08:08:30.841444 13325 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 218 LEADER]: Stepping down as leader of term 218
I20260615 08:08:30.841483 13325 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 218 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:30.841540 13325 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14436, Committed index: 14436, Last appended: 218.14436, Last appended by leader: 14436, Current term: 218, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.841624 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 218 FOLLOWER]: Advancing to term 220
I20260615 08:08:30.842095 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 220 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 218 index: 14436. Preceding OpId from leader: term: 220 index: 14437. (index mismatch)
I20260615 08:08:30.842327 13588 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14437, Last known committed idx: 14436, Time since last communication: 0.000s
I20260615 08:08:30.846570 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 220 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 218 index: 14436. Preceding OpId from leader: term: 220 index: 14437. (index mismatch)
I20260615 08:08:30.846766 13588 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14437, Last known committed idx: 14436, Time since last communication: 0.000s
I20260615 08:08:30.878082 13669 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 220 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:30.878177 13669 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 220 FOLLOWER]: Advancing to term 221
I20260615 08:08:30.878777 13669 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 221 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.878984 13669 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 221 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:30.879132 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 221 candidate_status { last_received { term: 220 index: 14437 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:30.879136 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 221 candidate_status { last_received { term: 220 index: 14437 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:30.879366 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 221 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:30.879482 13669 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 221 FOLLOWER]: Leader election lost for term 221. Reason: could not achieve majority
I20260615 08:08:30.882728 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 221 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 220. Current term is 221. Ops: []
I20260615 08:08:30.882925 13711 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 220.14437, Next index: 14438, Last known committed idx: 14437, Time since last communication: 0.000s
I20260615 08:08:30.913895 13669 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 221 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:30.913980 13669 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 221 FOLLOWER]: Advancing to term 222
I20260615 08:08:30.914572 13669 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 222 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.914724 13669 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 222 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:30.914847 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 222 candidate_status { last_received { term: 220 index: 14437 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:30.914868 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 222 candidate_status { last_received { term: 220 index: 14437 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:30.915035 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 222 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:30.915158 13669 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 222 FOLLOWER]: Leader election lost for term 222. Reason: could not achieve majority
I20260615 08:08:30.919368 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 222 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 220. Current term is 222. Ops: []
I20260615 08:08:30.919589 13588 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 220.14437, Next index: 14438, Last known committed idx: 14437, Time since last communication: 0.000s
I20260615 08:08:30.919721 13710 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 220 LEADER]: Stepping down as leader of term 220
I20260615 08:08:30.919764 13710 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 220 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:30.919828 13710 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14437, Committed index: 14437, Last appended: 220.14437, Last appended by leader: 14437, Current term: 220, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.919924 13710 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 220 FOLLOWER]: Advancing to term 221
I20260615 08:08:30.925391 13580 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 220 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:30.925438 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 220 FOLLOWER]: Advancing to term 221
I20260615 08:08:30.925869 13580 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 221 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.925992 13580 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 221 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:30.926131 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 221 candidate_status { last_received { term: 220 index: 14437 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:30.926131 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 221 candidate_status { last_received { term: 220 index: 14437 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:30.926246 13401 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 222 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 221. Current term is 222.
I20260615 08:08:30.926406 13289 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 221 election: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 222 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 221. Current term is 222.
I20260615 08:08:30.926443 13289 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 221 election: Cancelling election due to peer responding with higher term
I20260615 08:08:30.926517 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 221 FOLLOWER]: Advancing to term 222
I20260615 08:08:30.926867 13249 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 221 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 221.
I20260615 08:08:30.927052 13580 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 222 FOLLOWER]: Leader election lost for term 221. Reason: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 222 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 221. Current term is 222.
I20260615 08:08:30.957379 13710 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 221 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:30.957437 13710 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 221 FOLLOWER]: Advancing to term 222
I20260615 08:08:30.957525 13669 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 222 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:30.957589 13669 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 222 FOLLOWER]: Advancing to term 223
I20260615 08:08:30.958179 13710 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 222 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.958179 13669 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 223 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.958354 13669 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 223 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:30.958352 13710 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 222 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:30.958547 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 222 candidate_status { last_received { term: 220 index: 14437 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:30.958508 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 223 candidate_status { last_received { term: 220 index: 14437 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:30.958477 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 223 candidate_status { last_received { term: 220 index: 14437 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:30.958681 13249 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 222 FOLLOWER]: Advancing to term 223
I20260615 08:08:30.958667 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 222 FOLLOWER]: Advancing to term 223
I20260615 08:08:30.958627 13401 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 223 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 222. Current term is 223.
I20260615 08:08:30.958912 13213 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 222 election: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 223 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 222. Current term is 223.
I20260615 08:08:30.958981 13213 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 222 election: Cancelling election due to peer responding with higher term
I20260615 08:08:30.958519 13326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 222 candidate_status { last_received { term: 220 index: 14437 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:30.959308 13249 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 223 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 223.
I20260615 08:08:30.959308 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 223 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 223.
I20260615 08:08:30.959457 13710 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 223 FOLLOWER]: Leader election lost for term 222. Reason: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 223 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 222. Current term is 223.
I20260615 08:08:30.959538 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 223 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters:
I20260615 08:08:30.959610 13669 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 223 FOLLOWER]: Leader election won for term 223
I20260615 08:08:30.959645 13669 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 223 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:30.959717 13669 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14437, Committed index: 14437, Last appended: 220.14437, Last appended by leader: 14437, Current term: 223, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:30.960048 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 220 to 223, leader changed from 666bbeda390e4798abb1630585e244a1 (127.4.42.193) to b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195). New cstate: current_term: 223 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:30.984503 13249 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 223 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 220 index: 14437. Preceding OpId from leader: term: 223 index: 14438. (index mismatch)
W20260615 08:08:30.984665 13460 lock_manager.cc:494] Txn 9 has not acquired the partition lock after 1000ms
I20260615 08:08:30.984790 13669 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14438, Last known committed idx: 14437, Time since last communication: 0.000s
I20260615 08:08:30.989907 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 223 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 220 index: 14437. Preceding OpId from leader: term: 223 index: 14438. (index mismatch)
I20260615 08:08:30.990125 13654 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14438, Last known committed idx: 14437, Time since last communication: 0.000s
I20260615 08:08:31.020993 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 223 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:31.021063 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 223 FOLLOWER]: Advancing to term 224
I20260615 08:08:31.021668 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 224 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.021785 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 224 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 223. Current term is 224. Ops: []
I20260615 08:08:31.021821 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 224 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:31.021970 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 224 candidate_status { last_received { term: 223 index: 14438 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:31.021981 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 224 candidate_status { last_received { term: 223 index: 14438 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:31.021970 13654 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 223.14438, Next index: 14439, Last known committed idx: 14438, Time since last communication: 0.000s
I20260615 08:08:31.022305 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 224 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:31.022403 13522 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 224 FOLLOWER]: Leader election lost for term 224. Reason: could not achieve majority
I20260615 08:08:31.039990 13710 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 223 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:31.040056 13710 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 223 FOLLOWER]: Advancing to term 224
I20260615 08:08:31.040701 13710 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 224 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.040855 13710 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 224 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:31.041004 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 224 candidate_status { last_received { term: 223 index: 14438 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:31.041021 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 224 candidate_status { last_received { term: 223 index: 14438 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:31.041141 13325 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 224 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 in current term 224: Already voted for candidate d4d7c2ebbf334b19a7f964aab04f280f in this term.
I20260615 08:08:31.041285 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 224 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:31.041375 13710 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 224 FOLLOWER]: Leader election lost for term 224. Reason: could not achieve majority
I20260615 08:08:31.044878 13249 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 224 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 223. Current term is 224. Ops: []
I20260615 08:08:31.045090 13669 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 223.14438, Next index: 14439, Last known committed idx: 14438, Time since last communication: 0.000s
I20260615 08:08:31.051177 13696 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 223 LEADER]: Stepping down as leader of term 223
I20260615 08:08:31.051225 13696 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 223 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:31.051308 13696 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14438, Committed index: 14438, Last appended: 223.14438, Last appended by leader: 14438, Current term: 223, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.051410 13696 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 223 FOLLOWER]: Advancing to term 224
I20260615 08:08:31.055721 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 224 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:31.055790 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 224 FOLLOWER]: Advancing to term 225
I20260615 08:08:31.056319 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 225 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.056463 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 225 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:31.056648 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 225 candidate_status { last_received { term: 223 index: 14438 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:31.056697 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 225 candidate_status { last_received { term: 223 index: 14438 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:31.056710 13249 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 224 FOLLOWER]: Advancing to term 225
I20260615 08:08:31.056795 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 224 FOLLOWER]: Advancing to term 225
I20260615 08:08:31.057328 13249 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 225 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 225.
I20260615 08:08:31.057343 13401 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 225 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 225.
I20260615 08:08:31.057559 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 225 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters:
I20260615 08:08:31.057663 13522 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 225 FOLLOWER]: Leader election won for term 225
I20260615 08:08:31.057729 13522 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 225 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:31.057777 13522 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14438, Committed index: 14438, Last appended: 223.14438, Last appended by leader: 14438, Current term: 225, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.058166 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 223 to 225, leader changed from b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195) to d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194). New cstate: current_term: 225 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:31.084632 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 225 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 223 index: 14438. Preceding OpId from leader: term: 225 index: 14439. (index mismatch)
I20260615 08:08:31.084937 13522 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14439, Last known committed idx: 14438, Time since last communication: 0.000s
I20260615 08:08:31.092485 13249 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 225 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 223 index: 14438. Preceding OpId from leader: term: 225 index: 14439. (index mismatch)
I20260615 08:08:31.092721 13522 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14439, Last known committed idx: 14438, Time since last communication: 0.000s
I20260615 08:08:31.151402 13710 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 225 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:31.151489 13710 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 225 FOLLOWER]: Advancing to term 226
I20260615 08:08:31.152139 13710 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 226 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.152326 13710 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 226 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:31.152498 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 226 candidate_status { last_received { term: 225 index: 14439 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:31.152544 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 226 candidate_status { last_received { term: 225 index: 14439 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:31.152767 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 226 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:31.152865 13710 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 226 FOLLOWER]: Leader election lost for term 226. Reason: could not achieve majority
I20260615 08:08:31.154249 13249 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 226 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 225. Current term is 226. Ops: []
I20260615 08:08:31.154534 13522 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 225.14439, Next index: 14440, Last known committed idx: 14439, Time since last communication: 0.000s
I20260615 08:08:31.163965 13696 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 225 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:31.164041 13696 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 225 FOLLOWER]: Advancing to term 226
I20260615 08:08:31.164728 13696 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 226 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.164878 13696 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 226 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:31.165030 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 226 candidate_status { last_received { term: 225 index: 14439 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:31.165041 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 226 candidate_status { last_received { term: 225 index: 14439 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:31.165199 13249 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 226 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c in current term 226: Already voted for candidate 666bbeda390e4798abb1630585e244a1 in this term.
I20260615 08:08:31.165366 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 226 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:31.165472 13696 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 226 FOLLOWER]: Leader election lost for term 226. Reason: could not achieve majority
I20260615 08:08:31.166754 13689 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 225 LEADER]: Stepping down as leader of term 225
I20260615 08:08:31.166834 13689 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 225 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:31.166908 13689 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14439, Committed index: 14439, Last appended: 225.14439, Last appended by leader: 14439, Current term: 225, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.167012 13689 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 225 FOLLOWER]: Advancing to term 226
I20260615 08:08:31.189254 13710 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 226 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:31.189311 13710 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 226 FOLLOWER]: Advancing to term 227
I20260615 08:08:31.189889 13710 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 227 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.190143 13710 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 227 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:31.190203 13689 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 226 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:31.190294 13689 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 226 FOLLOWER]: Advancing to term 227
I20260615 08:08:31.190267 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 227 candidate_status { last_received { term: 225 index: 14439 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:31.190316 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 227 candidate_status { last_received { term: 225 index: 14439 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:31.190373 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 226 FOLLOWER]: Advancing to term 227
I20260615 08:08:31.191028 13401 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 227 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 227.
I20260615 08:08:31.191075 13689 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 227 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.191218 13325 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 227 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 in current term 227: Already voted for candidate d4d7c2ebbf334b19a7f964aab04f280f in this term.
I20260615 08:08:31.191278 13689 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 227 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:31.191291 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 227 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters:
I20260615 08:08:31.191447 13710 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 227 FOLLOWER]: Leader election won for term 227
I20260615 08:08:31.191468 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 227 candidate_status { last_received { term: 225 index: 14439 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:31.191500 13710 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 227 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:31.191521 13401 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 227 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f in current term 227: Already voted for candidate 666bbeda390e4798abb1630585e244a1 in this term.
I20260615 08:08:31.191550 13710 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14439, Committed index: 14439, Last appended: 225.14439, Last appended by leader: 14439, Current term: 227, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.191597 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 227 candidate_status { last_received { term: 225 index: 14439 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:31.191843 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 227 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:31.191973 13689 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 227 FOLLOWER]: Leader election lost for term 227. Reason: could not achieve majority
I20260615 08:08:31.192018 13146 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 225 to 227, leader changed from d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194) to 666bbeda390e4798abb1630585e244a1 (127.4.42.193). New cstate: current_term: 227 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:31.217343 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 227 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 225 index: 14439. Preceding OpId from leader: term: 227 index: 14440. (index mismatch)
I20260615 08:08:31.217634 13710 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14440, Last known committed idx: 14439, Time since last communication: 0.000s
I20260615 08:08:31.225214 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 227 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 225 index: 14439. Preceding OpId from leader: term: 227 index: 14440. (index mismatch)
I20260615 08:08:31.225440 13710 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14440, Last known committed idx: 14439, Time since last communication: 0.000s
I20260615 08:08:31.274724 13696 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 227 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:31.274806 13696 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 227 FOLLOWER]: Advancing to term 228
I20260615 08:08:31.275461 13696 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 228 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.275627 13696 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 228 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:31.275772 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 228 candidate_status { last_received { term: 227 index: 14440 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:31.275807 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 228 candidate_status { last_received { term: 227 index: 14440 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:31.276062 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 228 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:31.276186 13696 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 228 FOLLOWER]: Leader election lost for term 228. Reason: could not achieve majority
I20260615 08:08:31.277325 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 228 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 227. Current term is 228. Ops: []
I20260615 08:08:31.277521 13710 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 227.14440, Next index: 14441, Last known committed idx: 14440, Time since last communication: 0.000s
I20260615 08:08:31.303668 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 228 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 227. Current term is 228. Ops: []
I20260615 08:08:31.303959 13588 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 227.14440, Next index: 14441, Last known committed idx: 14440, Time since last communication: 0.000s
I20260615 08:08:31.310058 13710 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 227 LEADER]: Stepping down as leader of term 227
I20260615 08:08:31.310053 13696 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 228 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:31.310155 13710 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 227 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:31.310166 13696 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 228 FOLLOWER]: Advancing to term 229
I20260615 08:08:31.310216 13710 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14440, Committed index: 14440, Last appended: 227.14440, Last appended by leader: 14440, Current term: 227, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.310313 13710 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 227 FOLLOWER]: Advancing to term 228
I20260615 08:08:31.311004 13696 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 229 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.311165 13696 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 229 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:31.311316 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 229 candidate_status { last_received { term: 227 index: 14440 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:31.311381 13249 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 228 FOLLOWER]: Advancing to term 229
I20260615 08:08:31.311357 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 229 candidate_status { last_received { term: 227 index: 14440 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:31.311977 13249 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 229 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 229.
I20260615 08:08:31.312196 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 229 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters: d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:31.312285 13696 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 229 FOLLOWER]: Leader election won for term 229
I20260615 08:08:31.312337 13696 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 229 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:31.312386 13696 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14440, Committed index: 14440, Last appended: 227.14440, Last appended by leader: 14440, Current term: 229, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.312832 13146 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 227 to 229, leader changed from 666bbeda390e4798abb1630585e244a1 (127.4.42.193) to b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195). New cstate: current_term: 229 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:31.316202 13689 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 227 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:31.316280 13689 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 227 FOLLOWER]: Advancing to term 228
I20260615 08:08:31.316795 13689 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 228 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.316941 13689 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 228 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:31.317090 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 228 candidate_status { last_received { term: 227 index: 14440 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:31.317092 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 228 candidate_status { last_received { term: 227 index: 14440 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:31.317184 13249 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 229 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 228. Current term is 229.
I20260615 08:08:31.317343 13289 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 228 election: Vote denied by peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 229 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 228. Current term is 229.
I20260615 08:08:31.317375 13289 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 228 election: Cancelling election due to peer responding with higher term
I20260615 08:08:31.317435 13689 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 228 FOLLOWER]: Advancing to term 229
I20260615 08:08:31.317929 13689 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 229 FOLLOWER]: Leader election lost for term 228. Reason: Vote denied by peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 229 FOLLOWER]: Leader election vote request: Denying vote to candidate d4d7c2ebbf334b19a7f964aab04f280f for earlier term 228. Current term is 229.
I20260615 08:08:31.335690 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 229 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 227 index: 14440. Preceding OpId from leader: term: 229 index: 14441. (index mismatch)
I20260615 08:08:31.335943 13696 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14441, Last known committed idx: 14440, Time since last communication: 0.000s
I20260615 08:08:31.340016 13249 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 229 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 227 index: 14440. Preceding OpId from leader: term: 229 index: 14441. (index mismatch)
I20260615 08:08:31.340273 13669 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14441, Last known committed idx: 14440, Time since last communication: 0.000s
I20260615 08:08:31.367413 13689 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 229 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:31.367539 13689 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 229 FOLLOWER]: Advancing to term 230
I20260615 08:08:31.368217 13689 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 230 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.368389 13689 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 230 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:31.368582 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 230 candidate_status { last_received { term: 229 index: 14441 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:31.368608 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 230 candidate_status { last_received { term: 229 index: 14441 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:31.368868 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 230 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:31.369005 13689 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 230 FOLLOWER]: Leader election lost for term 230. Reason: could not achieve majority
I20260615 08:08:31.370788 13710 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 229 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:31.370833 13710 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 229 FOLLOWER]: Advancing to term 230
I20260615 08:08:31.371171 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 230 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 229. Current term is 230. Ops: []
I20260615 08:08:31.371378 13669 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 229.14441, Next index: 14442, Last known committed idx: 14441, Time since last communication: 0.000s
I20260615 08:08:31.371803 13710 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 230 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.371901 13249 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 230 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 229. Current term is 230. Ops: []
I20260615 08:08:31.372015 13710 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 230 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:31.372062 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 230 candidate_status { last_received { term: 229 index: 14441 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:31.372062 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 230 candidate_status { last_received { term: 229 index: 14441 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:31.372151 13325 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 230 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 in current term 230: Already voted for candidate d4d7c2ebbf334b19a7f964aab04f280f in this term.
I20260615 08:08:31.372108 13696 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 229.14441, Next index: 14442, Last known committed idx: 14441, Time since last communication: 0.000s
I20260615 08:08:31.372296 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 230 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:31.372376 13710 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 230 FOLLOWER]: Leader election lost for term 230. Reason: could not achieve majority
I20260615 08:08:31.398850 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 230 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 229. Current term is 230. Ops: []
I20260615 08:08:31.399287 13696 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 229.14441, Next index: 14442, Last known committed idx: 14441, Time since last communication: 0.000s
I20260615 08:08:31.399657 13249 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 230 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 229. Current term is 230. Ops: []
I20260615 08:08:31.399906 13654 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 229.14441, Next index: 14442, Last known committed idx: 14441, Time since last communication: 0.000s
I20260615 08:08:31.402971 13710 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 230 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:31.403031 13710 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 230 FOLLOWER]: Advancing to term 231
I20260615 08:08:31.403694 13710 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 231 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.403894 13710 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 231 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:31.404048 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 231 candidate_status { last_received { term: 229 index: 14441 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:31.404033 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 231 candidate_status { last_received { term: 229 index: 14441 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:31.404136 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 230 FOLLOWER]: Advancing to term 231
I20260615 08:08:31.404714 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 231 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 231.
I20260615 08:08:31.404908 13215 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 231 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters: b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:31.405000 13710 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 231 FOLLOWER]: Leader election won for term 231
I20260615 08:08:31.405058 13710 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 231 LEADER]: Becoming Leader. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:31.405125 13710 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14441, Committed index: 14441, Last appended: 229.14441, Last appended by leader: 14441, Current term: 231, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.405606 13142 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 reported cstate change: term changed from 229 to 231, leader changed from b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195) to 666bbeda390e4798abb1630585e244a1 (127.4.42.193). New cstate: current_term: 231 leader_uuid: "666bbeda390e4798abb1630585e244a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:31.425801 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 231 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 229. Current term is 231. Ops: []
I20260615 08:08:31.426055 13669 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 229.14441, Next index: 14442, Last known committed idx: 14441, Time since last communication: 0.000s
I20260615 08:08:31.428704 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 231 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 229 index: 14441. Preceding OpId from leader: term: 231 index: 14442. (index mismatch)
I20260615 08:08:31.428946 13710 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14442, Last known committed idx: 14441, Time since last communication: 0.000s
I20260615 08:08:31.435405 13249 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 231 LEADER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 229. Current term is 231. Ops: []
I20260615 08:08:31.435616 13654 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 229.14441, Next index: 14442, Last known committed idx: 14442, Time since last communication: 0.000s
I20260615 08:08:31.435701 13654 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer 666bbeda390e4798abb1630585e244a1 log is divergent from this leader: its last log entry 231.14442 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14442
I20260615 08:08:31.435725 13401 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 229 LEADER]: Stepping down as leader of term 229
I20260615 08:08:31.435765 13401 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 229 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:31.435854 13401 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14441, Committed index: 14441, Last appended: 229.14441, Last appended by leader: 14441, Current term: 229, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.435932 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 229 FOLLOWER]: Advancing to term 231
I20260615 08:08:31.436486 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 231 FOLLOWER]: Refusing update from remote peer 666bbeda390e4798abb1630585e244a1: Log matching property violated. Preceding OpId in replica: term: 229 index: 14441. Preceding OpId from leader: term: 231 index: 14442. (index mismatch)
I20260615 08:08:31.436702 13710 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14442, Last known committed idx: 14441, Time since last communication: 0.000s
I20260615 08:08:31.488943 13689 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 231 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:31.489068 13689 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 231 FOLLOWER]: Advancing to term 232
I20260615 08:08:31.489717 13689 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 232 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.489892 13689 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 232 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:31.490120 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 232 candidate_status { last_received { term: 231 index: 14442 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:31.490095 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 232 candidate_status { last_received { term: 231 index: 14442 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:31.490372 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 232 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:31.490460 13689 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 232 FOLLOWER]: Leader election lost for term 232. Reason: could not achieve majority
I20260615 08:08:31.494087 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 232 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 231. Current term is 232. Ops: []
I20260615 08:08:31.494294 13710 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 231.14442, Next index: 14443, Last known committed idx: 14442, Time since last communication: 0.000s
I20260615 08:08:31.516973 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 232 FOLLOWER]: Rejecting Update request from peer 666bbeda390e4798abb1630585e244a1 for earlier term 231. Current term is 232. Ops: []
I20260615 08:08:31.517271 13710 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 231.14442, Next index: 14443, Last known committed idx: 14442, Time since last communication: 0.000s
I20260615 08:08:31.518501 13711 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 231 LEADER]: Stepping down as leader of term 231
I20260615 08:08:31.518550 13711 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 231 LEADER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Running, Role: LEADER
I20260615 08:08:31.518627 13711 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14442, Committed index: 14442, Last appended: 231.14442, Last appended by leader: 14442, Current term: 231, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.518726 13711 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 231 FOLLOWER]: Advancing to term 232
I20260615 08:08:31.525354 13689 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 232 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:31.525416 13689 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 232 FOLLOWER]: Advancing to term 233
I20260615 08:08:31.526024 13689 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 233 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.526188 13689 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 233 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:31.526379 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 233 candidate_status { last_received { term: 231 index: 14442 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:31.526387 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 233 candidate_status { last_received { term: 231 index: 14442 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:31.526589 13249 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 232 FOLLOWER]: Advancing to term 233
I20260615 08:08:31.527133 13249 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 233 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 233.
I20260615 08:08:31.527345 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 233 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters: b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:31.527441 13689 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 233 FOLLOWER]: Leader election won for term 233
I20260615 08:08:31.527496 13689 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 233 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:31.527566 13689 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14442, Committed index: 14442, Last appended: 231.14442, Last appended by leader: 14442, Current term: 233, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.528018 13146 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 231 to 233, leader changed from 666bbeda390e4798abb1630585e244a1 (127.4.42.193) to d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194). New cstate: current_term: 233 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:31.543718 13654 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 231 FOLLOWER]: Starting leader election (detected failure of leader 666bbeda390e4798abb1630585e244a1)
I20260615 08:08:31.543783 13654 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 231 FOLLOWER]: Advancing to term 232
I20260615 08:08:31.544389 13654 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 232 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.544540 13654 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 232 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:31.544713 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 232 candidate_status { last_received { term: 231 index: 14442 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:31.544745 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 232 candidate_status { last_received { term: 231 index: 14442 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:31.544797 13249 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 233 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 232. Current term is 233.
I20260615 08:08:31.544968 13364 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 232 election: Vote denied by peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 233 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 232. Current term is 233.
I20260615 08:08:31.545022 13364 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 232 election: Cancelling election due to peer responding with higher term
I20260615 08:08:31.545105 13654 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 232 FOLLOWER]: Advancing to term 233
I20260615 08:08:31.545620 13654 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 233 FOLLOWER]: Leader election lost for term 232. Reason: Vote denied by peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 233 FOLLOWER]: Leader election vote request: Denying vote to candidate b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 232. Current term is 233.
I20260615 08:08:31.561345 13249 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 233 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 231 index: 14442. Preceding OpId from leader: term: 233 index: 14443. (index mismatch)
I20260615 08:08:31.561645 13689 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14443, Last known committed idx: 14442, Time since last communication: 0.000s
I20260615 08:08:31.562880 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 233 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 231 index: 14442. Preceding OpId from leader: term: 233 index: 14443. (index mismatch)
I20260615 08:08:31.563035 13580 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14443, Last known committed idx: 14442, Time since last communication: 0.000s
I20260615 08:08:31.594065 13696 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 233 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:31.594133 13696 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 233 FOLLOWER]: Advancing to term 234
I20260615 08:08:31.594790 13696 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 234 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.595013 13696 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 234 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:31.595089 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 234 candidate_status { last_received { term: 233 index: 14443 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:31.595224 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 234 candidate_status { last_received { term: 233 index: 14443 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:31.595366 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 234 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:31.595479 13696 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 234 FOLLOWER]: Leader election lost for term 234. Reason: could not achieve majority
I20260615 08:08:31.618753 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 234 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 233. Current term is 234. Ops: []
I20260615 08:08:31.619009 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 233.14443, Next index: 14444, Last known committed idx: 14443, Time since last communication: 0.000s
I20260615 08:08:31.635103 13696 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 234 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:31.635167 13696 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 234 FOLLOWER]: Advancing to term 235
I20260615 08:08:31.635804 13696 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 235 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.635957 13696 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 235 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:31.636137 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 235 candidate_status { last_received { term: 233 index: 14443 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:31.636137 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 235 candidate_status { last_received { term: 233 index: 14443 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:31.636389 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 235 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:31.636530 13696 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 235 FOLLOWER]: Leader election lost for term 235. Reason: could not achieve majority
I20260615 08:08:31.641227 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 235 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 233. Current term is 235. Ops: []
I20260615 08:08:31.641414 13522 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 233.14443, Next index: 14444, Last known committed idx: 14443, Time since last communication: 0.000s
I20260615 08:08:31.665043 13580 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 233 LEADER]: Stepping down as leader of term 233
I20260615 08:08:31.665110 13580 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 233 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:31.665194 13580 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14443, Committed index: 14443, Last appended: 233.14443, Last appended by leader: 14443, Current term: 233, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.665287 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 233 FOLLOWER]: Advancing to term 234
I20260615 08:08:31.677467 13711 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 233 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:31.677563 13711 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 233 FOLLOWER]: Advancing to term 234
I20260615 08:08:31.678169 13711 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 234 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.678359 13711 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 234 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:31.678527 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 234 candidate_status { last_received { term: 233 index: 14443 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:31.678574 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 234 candidate_status { last_received { term: 233 index: 14443 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:31.678655 13401 raft_consensus.cc:2368] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 235 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 234. Current term is 235.
I20260615 08:08:31.678824 13213 leader_election.cc:400] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 234 election: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 235 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 234. Current term is 235.
I20260615 08:08:31.678889 13213 leader_election.cc:403] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 234 election: Cancelling election due to peer responding with higher term
I20260615 08:08:31.678946 13711 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 234 FOLLOWER]: Advancing to term 235
I20260615 08:08:31.679226 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 234 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 666bbeda390e4798abb1630585e244a1 in term 234.
I20260615 08:08:31.679576 13711 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 235 FOLLOWER]: Leader election lost for term 234. Reason: Vote denied by peer b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159) with higher term. Message: Invalid argument: T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 235 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 for earlier term 234. Current term is 235.
I20260615 08:08:31.697086 13696 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 235 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:31.697152 13696 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 235 FOLLOWER]: Advancing to term 236
I20260615 08:08:31.697773 13696 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 236 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.697928 13696 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 236 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:31.698112 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 236 candidate_status { last_received { term: 233 index: 14443 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:31.698123 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 236 candidate_status { last_received { term: 233 index: 14443 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:31.698213 13249 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 235 FOLLOWER]: Advancing to term 236
I20260615 08:08:31.698252 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 234 FOLLOWER]: Advancing to term 236
I20260615 08:08:31.698869 13325 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 236 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 236.
I20260615 08:08:31.698930 13249 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 236 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 236.
I20260615 08:08:31.699100 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 236 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f; no voters:
I20260615 08:08:31.699193 13696 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 236 FOLLOWER]: Leader election won for term 236
I20260615 08:08:31.699271 13696 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 236 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:31.699333 13696 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14443, Committed index: 14443, Last appended: 233.14443, Last appended by leader: 14443, Current term: 236, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.699757 13146 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 233 to 236, leader changed from d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194) to b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195). New cstate: current_term: 236 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:31.721958 13249 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 236 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 233 index: 14443. Preceding OpId from leader: term: 236 index: 14444. (index mismatch)
I20260615 08:08:31.722214 13696 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14444, Last known committed idx: 14443, Time since last communication: 0.000s
I20260615 08:08:31.730321 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 236 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 233 index: 14443. Preceding OpId from leader: term: 236 index: 14444. (index mismatch)
I20260615 08:08:31.730616 13696 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14444, Last known committed idx: 14443, Time since last communication: 0.000s
I20260615 08:08:31.762123 13580 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 236 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:31.762234 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 236 FOLLOWER]: Advancing to term 237
I20260615 08:08:31.762923 13580 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 237 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.763092 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 237 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 236. Current term is 237. Ops: []
I20260615 08:08:31.763105 13580 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 237 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:31.763257 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 237 candidate_status { last_received { term: 236 index: 14444 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:31.763319 13696 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 236.14444, Next index: 14445, Last known committed idx: 14444, Time since last communication: 0.000s
I20260615 08:08:31.763243 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 237 candidate_status { last_received { term: 236 index: 14444 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:31.763588 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 237 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:31.763692 13580 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 237 FOLLOWER]: Leader election lost for term 237. Reason: could not achieve majority
I20260615 08:08:31.780512 13711 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 236 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:31.780575 13711 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 236 FOLLOWER]: Advancing to term 237
I20260615 08:08:31.781200 13711 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 237 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.781353 13711 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 237 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:31.781486 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 237 candidate_status { last_received { term: 236 index: 14444 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:31.781493 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 237 candidate_status { last_received { term: 236 index: 14444 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:31.781613 13325 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 237 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 in current term 237: Already voted for candidate d4d7c2ebbf334b19a7f964aab04f280f in this term.
I20260615 08:08:31.781798 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 237 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:31.781893 13711 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 237 FOLLOWER]: Leader election lost for term 237. Reason: could not achieve majority
I20260615 08:08:31.783730 13249 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 237 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 236. Current term is 237. Ops: []
I20260615 08:08:31.783921 13669 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 236.14444, Next index: 14445, Last known committed idx: 14444, Time since last communication: 0.000s
I20260615 08:08:31.789186 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 237 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 236. Current term is 237. Ops: []
I20260615 08:08:31.789422 13696 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 236.14444, Next index: 14445, Last known committed idx: 14444, Time since last communication: 0.000s
I20260615 08:08:31.795614 13580 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 237 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:31.795683 13580 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 237 FOLLOWER]: Advancing to term 238
I20260615 08:08:31.796269 13580 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 238 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.796413 13580 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 238 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:31.796584 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 238 candidate_status { last_received { term: 236 index: 14444 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:31.796588 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 238 candidate_status { last_received { term: 236 index: 14444 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:31.796660 13249 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 237 FOLLOWER]: Advancing to term 238
I20260615 08:08:31.797225 13249 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 238 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4d7c2ebbf334b19a7f964aab04f280f in term 238.
I20260615 08:08:31.797384 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 238 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f; no voters: b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:31.797477 13580 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 238 FOLLOWER]: Leader election won for term 238
I20260615 08:08:31.797551 13580 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 238 LEADER]: Becoming Leader. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:31.797607 13580 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14444, Committed index: 14444, Last appended: 236.14444, Last appended by leader: 14444, Current term: 238, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.798010 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f reported cstate change: term changed from 236 to 238, leader changed from b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195) to d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194). New cstate: current_term: 238 leader_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:31.811338 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 238 LEADER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 236. Current term is 238. Ops: []
I20260615 08:08:31.811722 13696 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 236.14444, Next index: 14445, Last known committed idx: 14444, Time since last communication: 0.000s
I20260615 08:08:31.811861 13696 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer d4d7c2ebbf334b19a7f964aab04f280f log is divergent from this leader: its last log entry 238.14445 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14444
I20260615 08:08:31.811905 13249 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 238 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 236. Current term is 238. Ops: []
I20260615 08:08:31.812153 13696 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 236.14444, Next index: 14445, Last known committed idx: 14444, Time since last communication: 0.000s
I20260615 08:08:31.816473 13654 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 236 LEADER]: Stepping down as leader of term 236
I20260615 08:08:31.816515 13654 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 236 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:31.816557 13654 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14444, Committed index: 14444, Last appended: 236.14444, Last appended by leader: 14444, Current term: 236, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.816670 13654 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 236 FOLLOWER]: Advancing to term 237
I20260615 08:08:31.826258 13401 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 237 FOLLOWER]: Advancing to term 238
I20260615 08:08:31.826893 13401 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 238 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 236 index: 14444. Preceding OpId from leader: term: 238 index: 14445. (index mismatch)
I20260615 08:08:31.827154 13580 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14445, Last known committed idx: 14444, Time since last communication: 0.000s
I20260615 08:08:31.829154 13249 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 238 FOLLOWER]: Refusing update from remote peer d4d7c2ebbf334b19a7f964aab04f280f: Log matching property violated. Preceding OpId in replica: term: 236 index: 14444. Preceding OpId from leader: term: 238 index: 14445. (index mismatch)
I20260615 08:08:31.829365 13580 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14445, Last known committed idx: 14444, Time since last communication: 0.000s
I20260615 08:08:31.858825 13669 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 238 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:31.858912 13669 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 238 FOLLOWER]: Advancing to term 239
I20260615 08:08:31.859676 13669 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 239 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.859863 13669 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 239 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:31.859982 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 239 candidate_status { last_received { term: 238 index: 14445 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:31.860013 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 239 candidate_status { last_received { term: 238 index: 14445 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:31.860298 13366 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 239 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:31.860389 13669 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 239 FOLLOWER]: Leader election lost for term 239. Reason: could not achieve majority
I20260615 08:08:31.864154 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 239 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 238. Current term is 239. Ops: []
I20260615 08:08:31.864362 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 238.14445, Next index: 14446, Last known committed idx: 14445, Time since last communication: 0.000s
I20260615 08:08:31.889705 13711 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 238 FOLLOWER]: Starting leader election (detected failure of leader d4d7c2ebbf334b19a7f964aab04f280f)
I20260615 08:08:31.889827 13711 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 238 FOLLOWER]: Advancing to term 239
I20260615 08:08:31.890451 13711 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 239 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.890623 13249 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 239 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 238. Current term is 239. Ops: []
I20260615 08:08:31.890659 13711 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 239 election: Requested vote from peers d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:31.890766 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 239 candidate_status { last_received { term: 238 index: 14445 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:31.890787 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "666bbeda390e4798abb1630585e244a1" candidate_term: 239 candidate_status { last_received { term: 238 index: 14445 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:31.890861 13401 raft_consensus.cc:2393] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 239 FOLLOWER]: Leader election vote request: Denying vote to candidate 666bbeda390e4798abb1630585e244a1 in current term 239: Already voted for candidate b97b73a5f2ad444eb230680e3c3fcb6c in this term.
I20260615 08:08:31.890851 13522 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 238.14445, Next index: 14446, Last known committed idx: 14445, Time since last communication: 0.000s
I20260615 08:08:31.891053 13213 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [CANDIDATE]: Term 239 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 666bbeda390e4798abb1630585e244a1; no voters: b97b73a5f2ad444eb230680e3c3fcb6c, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:31.891142 13711 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 239 FOLLOWER]: Leader election lost for term 239. Reason: could not achieve majority
I20260615 08:08:31.892693 13669 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 239 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:31.892737 13669 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 239 FOLLOWER]: Advancing to term 240
I20260615 08:08:31.893298 13669 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 240 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.893440 13669 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 240 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
I20260615 08:08:31.893585 13325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 240 candidate_status { last_received { term: 238 index: 14445 } } ignore_live_leader: false dest_uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
I20260615 08:08:31.893566 13249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" candidate_term: 240 candidate_status { last_received { term: 238 index: 14445 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:31.893698 13249 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 239 FOLLOWER]: Advancing to term 240
I20260615 08:08:31.894276 13249 raft_consensus.cc:2468] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 240 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b97b73a5f2ad444eb230680e3c3fcb6c in term 240.
I20260615 08:08:31.894451 13364 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 240 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c; no voters: d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:31.894603 13669 raft_consensus.cc:2804] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 240 FOLLOWER]: Leader election won for term 240
I20260615 08:08:31.894662 13669 raft_consensus.cc:697] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 240 LEADER]: Becoming Leader. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:31.894727 13669 consensus_queue.cc:237] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14445, Committed index: 14445, Last appended: 238.14445, Last appended by leader: 14445, Current term: 240, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.895171 13145 catalog_manager.cc:5696] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c reported cstate change: term changed from 238 to 240, leader changed from d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194) to b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195). New cstate: current_term: 240 leader_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:31.901221 13401 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 240 LEADER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 238. Current term is 240. Ops: []
I20260615 08:08:31.901440 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 }, Status: INVALID_TERM, Last received: 238.14445, Next index: 14446, Last known committed idx: 14445, Time since last communication: 0.000s
I20260615 08:08:31.901520 13580 consensus_queue.cc:1243] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer b97b73a5f2ad444eb230680e3c3fcb6c log is divergent from this leader: its last log entry 240.14446 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14445
I20260615 08:08:31.922178 13249 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 240 FOLLOWER]: Rejecting Update request from peer d4d7c2ebbf334b19a7f964aab04f280f for earlier term 238. Current term is 240. Ops: []
I20260615 08:08:31.922513 13580 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: INVALID_TERM, Last received: 238.14445, Next index: 14446, Last known committed idx: 14445, Time since last communication: 0.000s
I20260615 08:08:31.922639 13325 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 238 LEADER]: Stepping down as leader of term 238
I20260615 08:08:31.922706 13325 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 238 LEADER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Running, Role: LEADER
I20260615 08:08:31.922786 13325 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14445, Committed index: 14445, Last appended: 238.14445, Last appended by leader: 14445, Current term: 238, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.922896 13325 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 238 FOLLOWER]: Advancing to term 240
I20260615 08:08:31.923504 13325 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 240 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 238 index: 14445. Preceding OpId from leader: term: 240 index: 14446. (index mismatch)
I20260615 08:08:31.923754 13669 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14446, Last known committed idx: 14445, Time since last communication: 0.000s
I20260615 08:08:31.927951 13249 raft_consensus.cc:1275] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 240 FOLLOWER]: Refusing update from remote peer b97b73a5f2ad444eb230680e3c3fcb6c: Log matching property violated. Preceding OpId in replica: term: 238 index: 14445. Preceding OpId from leader: term: 240 index: 14446. (index mismatch)
I20260615 08:08:31.928229 13654 consensus_queue.cc:1048] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14446, Last known committed idx: 14445, Time since last communication: 0.000s
W20260615 08:08:31.943768 13669 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 238 current term: 240 is higher.
W20260615 08:08:31.971930 13669 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 238 current term: 240 is higher.
I20260615 08:08:31.978336 13522 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 240 FOLLOWER]: Starting leader election (detected failure of leader b97b73a5f2ad444eb230680e3c3fcb6c)
I20260615 08:08:31.978430 13522 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 240 FOLLOWER]: Advancing to term 241
I20260615 08:08:31.979066 13522 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 241 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:31.979240 13522 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 241 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:40159)
I20260615 08:08:31.979481 13401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 241 candidate_status { last_received { term: 240 index: 14446 } } ignore_live_leader: false dest_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
I20260615 08:08:31.979475 13250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad08259deddd40febcaca9a4ceb302d4" candidate_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" candidate_term: 241 candidate_status { last_received { term: 240 index: 14446 } } ignore_live_leader: false dest_uuid: "666bbeda390e4798abb1630585e244a1"
I20260615 08:08:31.979784 13289 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [CANDIDATE]: Term 241 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d4d7c2ebbf334b19a7f964aab04f280f; no voters: 666bbeda390e4798abb1630585e244a1, b97b73a5f2ad444eb230680e3c3fcb6c
I20260615 08:08:31.979931 13522 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 241 FOLLOWER]: Leader election lost for term 241. Reason: could not achieve majority
I20260615 08:08:31.982936 13325 raft_consensus.cc:1240] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 241 FOLLOWER]: Rejecting Update request from peer b97b73a5f2ad444eb230680e3c3fcb6c for earlier term 240. Current term is 241. Ops: []
I20260615 08:08:31.983140 13718 consensus_queue.cc:1059] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 }, Status: INVALID_TERM, Last received: 240.14446, Next index: 14447, Last known committed idx: 14446, Time since last communication: 0.000s
W20260615 08:08:31.985775 13460 lock_manager.cc:494] Txn 9 has not acquired the partition lock after 1000ms
I20260615 08:08:31.986084 4267 tablet_server.cc:179] TabletServer@127.4.42.193:0 shutting down...
I20260615 08:08:31.988636 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:08:31.988755 4267 tablet_replica.cc:333] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1: stopping tablet replica
I20260615 08:08:31.988811 4267 raft_consensus.cc:2243] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 240 FOLLOWER]: Raft consensus shutting down.
I20260615 08:08:31.988853 4267 raft_consensus.cc:2272] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 240 FOLLOWER]: Raft consensus is shut down!
W20260615 08:08:31.991524 4267 mvcc.cc:118] aborting op with timestamp 7297068646610063360 in state 0; MVCC is closed
I20260615 08:08:32.003618 4267 tablet_server.cc:196] TabletServer@127.4.42.193:0 shutdown complete.
I20260615 08:08:32.004482 4267 tablet_server.cc:179] TabletServer@127.4.42.194:0 shutting down...
W20260615 08:08:32.006739 13364 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.42.193:40015: connect: Connection refused (error 111)
W20260615 08:08:32.007298 13364 consensus_peers.cc:597] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c -> Peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015): Couldn't send request to peer 666bbeda390e4798abb1630585e244a1. Status: Network error: Client connection negotiation failed: client connection to 127.4.42.193:40015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260615 08:08:32.007490 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:08:32.007581 4267 tablet_replica.cc:333] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f: stopping tablet replica
I20260615 08:08:32.007651 4267 raft_consensus.cc:2243] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 241 FOLLOWER]: Raft consensus shutting down.
I20260615 08:08:32.009546 4267 raft_consensus.cc:2272] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 241 FOLLOWER]: Raft consensus is shut down!
W20260615 08:08:32.017019 13366 consensus_peers.cc:597] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c -> Peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603): Couldn't send request to peer d4d7c2ebbf334b19a7f964aab04f280f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260615 08:08:32.021872 4267 mvcc.cc:118] aborting op with timestamp 7297068646610063360 in state 0; MVCC is closed
I20260615 08:08:32.032641 13669 raft_consensus.cc:3055] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 240 LEADER]: Stepping down as leader of term 240
I20260615 08:08:32.032689 13669 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 240 LEADER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Running, Role: LEADER
I20260615 08:08:32.032756 13669 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14446, Committed index: 14446, Last appended: 240.14446, Last appended by leader: 14446, Current term: 240, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:32.032853 13669 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 240 FOLLOWER]: Advancing to term 241
I20260615 08:08:32.034032 4267 tablet_server.cc:196] TabletServer@127.4.42.194:0 shutdown complete.
I20260615 08:08:32.034926 4267 tablet_server.cc:179] TabletServer@127.4.42.195:0 shutting down...
I20260615 08:08:32.037938 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:08:32.038043 4267 tablet_replica.cc:333] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c: stopping tablet replica
I20260615 08:08:32.038105 4267 raft_consensus.cc:2243] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 241 FOLLOWER]: Raft consensus shutting down.
I20260615 08:08:32.045670 4267 raft_consensus.cc:2272] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 241 FOLLOWER]: Raft consensus is shut down!
W20260615 08:08:32.048195 4267 mvcc.cc:118] aborting op with timestamp 7297068646610063360 in state 0; MVCC is closed
I20260615 08:08:32.060309 4267 tablet_server.cc:196] TabletServer@127.4.42.195:0 shutdown complete.
I20260615 08:08:32.061117 4267 master.cc:562] Master@127.4.42.254:37165 shutting down...
I20260615 08:08:32.063532 4267 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [term 1 LEADER]: Raft consensus shutting down.
I20260615 08:08:32.063611 4267 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:08:32.063630 4267 tablet_replica.cc:333] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d: stopping tablet replica
I20260615 08:08:32.075258 4267 master.cc:584] Master@127.4.42.254:37165 shutdown complete.
I20260615 08:08:32.076586 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260615 08:08:32.078109 4267 server_base.cc:1061] running on GCE node
W20260615 08:08:32.078164 13722 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:08:32.078181 13724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:08:32.078193 13721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:08:32.078428 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:08:32.078469 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:08:32.078524 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510912078523 us; error 0 us; skew 500 ppm
I20260615 08:08:32.079072 4267 webserver.cc:533] Webserver started at http://127.4.42.254:41249/ using document root <none> and password file <none>
I20260615 08:08:32.079164 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:08:32.079205 4267 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260615 08:08:32.079782 4267 fs_manager.cc:714] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260615 08:08:32.080204 13729 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:32.080328 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:32.080384 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/master-0-root
uuid: "57150f4ea2c148f886adbfcf490def0d"
format_stamp: "Formatted at 2026-06-15 08:08:09 on dist-test-slave-37n8"
I20260615 08:08:32.080438 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:08:32.092453 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:08:32.092639 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:08:32.095171 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.254:37165
I20260615 08:08:32.097987 13781 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.254:37165 every 8 connection(s)
I20260615 08:08:32.107208 13782 sys_catalog.cc:263] Verifying existing consensus state
I20260615 08:08:32.107596 13782 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d: Bootstrap starting.
I20260615 08:08:32.113936 13782 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d: Bootstrap replayed 1/1 log segments. Stats: ops{read=119 overwritten=0 applied=119 ignored=0} inserts{seen=5 ignored=0} mutations{seen=114 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260615 08:08:32.114210 13782 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d: Bootstrap complete.
I20260615 08:08:32.114454 13782 raft_consensus.cc:359] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57150f4ea2c148f886adbfcf490def0d" member_type: VOTER }
I20260615 08:08:32.114537 13782 raft_consensus.cc:740] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57150f4ea2c148f886adbfcf490def0d, State: Initialized, Role: FOLLOWER
I20260615 08:08:32.114600 13782 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 119, Last appended: 1.119, Last appended by leader: 119, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57150f4ea2c148f886adbfcf490def0d" member_type: VOTER }
I20260615 08:08:32.114660 13782 raft_consensus.cc:399] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260615 08:08:32.114686 13782 raft_consensus.cc:493] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260615 08:08:32.114732 13782 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:08:32.115211 13782 raft_consensus.cc:515] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57150f4ea2c148f886adbfcf490def0d" member_type: VOTER }
I20260615 08:08:32.115263 13782 leader_election.cc:304] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57150f4ea2c148f886adbfcf490def0d; no voters:
I20260615 08:08:32.115392 13782 leader_election.cc:290] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [CANDIDATE]: Term 2 election: Requested vote from peers
I20260615 08:08:32.115473 13785 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [term 2 FOLLOWER]: Leader election won for term 2
I20260615 08:08:32.115576 13782 sys_catalog.cc:565] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [sys.catalog]: configured and running, proceeding with master startup.
I20260615 08:08:32.115624 13785 raft_consensus.cc:697] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [term 2 LEADER]: Becoming Leader. State: Replica: 57150f4ea2c148f886adbfcf490def0d, State: Running, Role: LEADER
I20260615 08:08:32.115685 13785 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 119, Committed index: 119, Last appended: 1.119, Last appended by leader: 119, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57150f4ea2c148f886adbfcf490def0d" member_type: VOTER }
I20260615 08:08:32.115942 13786 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "57150f4ea2c148f886adbfcf490def0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57150f4ea2c148f886adbfcf490def0d" member_type: VOTER } }
I20260615 08:08:32.115947 13787 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57150f4ea2c148f886adbfcf490def0d. Latest consensus state: current_term: 2 leader_uuid: "57150f4ea2c148f886adbfcf490def0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57150f4ea2c148f886adbfcf490def0d" member_type: VOTER } }
I20260615 08:08:32.116029 13786 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [sys.catalog]: This master's current role is: LEADER
I20260615 08:08:32.116041 13787 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [sys.catalog]: This master's current role is: LEADER
I20260615 08:08:32.116219 13791 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260615 08:08:32.116490 13791 catalog_manager.cc:679] Loaded metadata for table test-workload [id=4c7106f7a97e4e4aa097c5d4abd55045]
I20260615 08:08:32.116689 13791 tablet_loader.cc:96] loaded metadata for tablet ad08259deddd40febcaca9a4ceb302d4 (table test-workload [id=4c7106f7a97e4e4aa097c5d4abd55045])
I20260615 08:08:32.116750 13791 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260615 08:08:32.116839 4267 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260615 08:08:32.116859 13791 catalog_manager.cc:1294] Loaded cluster ID: f9b128d7772b4ea2bfeaa97c8b08e382
I20260615 08:08:32.116883 13791 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260615 08:08:32.117574 13791 catalog_manager.cc:1539] Loading token signing keys...
I20260615 08:08:32.117712 13791 catalog_manager.cc:6080] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d: Loaded TSK: 0
I20260615 08:08:32.117791 13791 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260615 08:08:32.118085 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260615 08:08:32.118165 4267 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 15
W20260615 08:08:32.119248 13801 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:08:32.119328 4267 server_base.cc:1061] running on GCE node
W20260615 08:08:32.119248 13802 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:08:32.119453 13804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:08:32.119586 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:08:32.119637 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:08:32.119658 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510912119658 us; error 0 us; skew 500 ppm
I20260615 08:08:32.120167 4267 webserver.cc:533] Webserver started at http://127.4.42.193:36149/ using document root <none> and password file <none>
I20260615 08:08:32.120265 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:08:32.120301 4267 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260615 08:08:32.120784 4267 fs_manager.cc:714] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260615 08:08:32.121227 13809 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:32.121356 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:32.121414 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/ts-0-root
uuid: "666bbeda390e4798abb1630585e244a1"
format_stamp: "Formatted at 2026-06-15 08:08:09 on dist-test-slave-37n8"
I20260615 08:08:32.121460 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:08:32.126230 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:08:32.126403 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:08:32.126556 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:08:32.126830 13816 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260615 08:08:32.127318 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260615 08:08:32.127367 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20260615 08:08:32.127404 4267 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260615 08:08:32.127818 4267 ts_tablet_manager.cc:616] Registered 1 tablets
I20260615 08:08:32.127858 13816 tablet_bootstrap.cc:492] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1: Bootstrap starting.
I20260615 08:08:32.127866 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:32.130851 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.193:36005
I20260615 08:08:32.131321 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260615 08:08:32.131453 4267 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 15
I20260615 08:08:32.132422 13874 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.193:36005 every 8 connection(s)
W20260615 08:08:32.133129 13877 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:08:32.133258 13878 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:08:32.133185 13880 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:08:32.133849 4267 server_base.cc:1061] running on GCE node
I20260615 08:08:32.133971 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:08:32.134028 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:08:32.134053 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510912134054 us; error 0 us; skew 500 ppm
I20260615 08:08:32.134642 4267 webserver.cc:533] Webserver started at http://127.4.42.194:42677/ using document root <none> and password file <none>
I20260615 08:08:32.134740 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:08:32.134781 4267 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260615 08:08:32.136134 4267 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:08:32.136611 13887 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:32.136751 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:32.136797 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/ts-1-root
uuid: "d4d7c2ebbf334b19a7f964aab04f280f"
format_stamp: "Formatted at 2026-06-15 08:08:09 on dist-test-slave-37n8"
I20260615 08:08:32.136799 13875 heartbeater.cc:344] Connected to a master server at 127.4.42.254:37165
I20260615 08:08:32.136855 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:08:32.136878 13875 heartbeater.cc:461] Registering TS with master...
I20260615 08:08:32.136969 13875 heartbeater.cc:507] Master 127.4.42.254:37165 requested a full tablet report, sending...
I20260615 08:08:32.137248 13746 ts_manager.cc:194] Registered new tserver with Master: 666bbeda390e4798abb1630585e244a1 (127.4.42.193:36005)
I20260615 08:08:32.138095 13746 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51776
I20260615 08:08:32.145931 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:08:32.146118 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:08:32.146266 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:08:32.147209 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260615 08:08:32.147292 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20260615 08:08:32.147672 4267 ts_tablet_manager.cc:616] Registered 1 tablets
I20260615 08:08:32.147723 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:32.147727 13894 tablet_bootstrap.cc:492] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f: Bootstrap starting.
I20260615 08:08:32.151700 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.194:42091
I20260615 08:08:32.152034 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260615 08:08:32.152148 4267 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 15
W20260615 08:08:32.153053 13956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:08:32.155130 13953 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.194:42091 every 8 connection(s)
W20260615 08:08:32.155529 13957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:08:32.155961 13959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:08:32.156209 4267 server_base.cc:1061] running on GCE node
I20260615 08:08:32.156378 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:08:32.156442 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:08:32.156498 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510912156498 us; error 0 us; skew 500 ppm
I20260615 08:08:32.157356 4267 webserver.cc:533] Webserver started at http://127.4.42.195:41953/ using document root <none> and password file <none>
I20260615 08:08:32.157485 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:08:32.157577 4267 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260615 08:08:32.157943 13954 heartbeater.cc:344] Connected to a master server at 127.4.42.254:37165
I20260615 08:08:32.158018 13954 heartbeater.cc:461] Registering TS with master...
I20260615 08:08:32.158134 13954 heartbeater.cc:507] Master 127.4.42.254:37165 requested a full tablet report, sending...
I20260615 08:08:32.158376 13746 ts_manager.cc:194] Registered new tserver with Master: d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:42091)
I20260615 08:08:32.158713 4267 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:08:32.158921 13746 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51782
I20260615 08:08:32.162619 13965 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:32.162760 4267 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.000s sys 0.000s
I20260615 08:08:32.162802 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/ts-2-root
uuid: "b97b73a5f2ad444eb230680e3c3fcb6c"
format_stamp: "Formatted at 2026-06-15 08:08:09 on dist-test-slave-37n8"
I20260615 08:08:32.162854 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestFrequentElections.1781510637089012-4267-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:08:32.175336 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:08:32.175575 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:08:32.175745 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:08:32.176563 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260615 08:08:32.176612 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20260615 08:08:32.177042 4267 ts_tablet_manager.cc:616] Registered 1 tablets
I20260615 08:08:32.177083 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:32.177192 13972 tablet_bootstrap.cc:492] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c: Bootstrap starting.
I20260615 08:08:32.181278 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.195:34097
I20260615 08:08:32.183789 14030 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.195:34097 every 8 connection(s)
I20260615 08:08:32.187644 14031 heartbeater.cc:344] Connected to a master server at 127.4.42.254:37165
I20260615 08:08:32.187705 14031 heartbeater.cc:461] Registering TS with master...
I20260615 08:08:32.187808 14031 heartbeater.cc:507] Master 127.4.42.254:37165 requested a full tablet report, sending...
I20260615 08:08:32.188052 13746 ts_manager.cc:194] Registered new tserver with Master: b97b73a5f2ad444eb230680e3c3fcb6c (127.4.42.195:34097)
I20260615 08:08:32.188501 13746 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51788
I20260615 08:08:32.189109 4267 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.007630769s
I20260615 08:08:32.886967 13972 tablet_bootstrap.cc:492] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c: Bootstrap replayed 1/3 log segments. Stats: ops{read=4968 overwritten=0 applied=4965 ignored=0} inserts{seen=248200 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 3 replicates
I20260615 08:08:33.138671 13875 heartbeater.cc:499] Master 127.4.42.254:37165 was elected leader, sending a full tablet report...
I20260615 08:08:33.159438 13954 heartbeater.cc:499] Master 127.4.42.254:37165 was elected leader, sending a full tablet report...
I20260615 08:08:33.189023 14031 heartbeater.cc:499] Master 127.4.42.254:37165 was elected leader, sending a full tablet report...
I20260615 08:08:33.284708 13816 tablet_bootstrap.cc:492] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1: Bootstrap replayed 1/4 log segments. Stats: ops{read=4631 overwritten=0 applied=4628 ignored=0} inserts{seen=231350 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 3 replicates
I20260615 08:08:33.397109 13894 tablet_bootstrap.cc:492] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f: Bootstrap replayed 1/3 log segments. Stats: ops{read=4975 overwritten=0 applied=4974 ignored=0} inserts{seen=248650 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260615 08:08:33.603489 13972 tablet_bootstrap.cc:492] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c: Bootstrap replayed 2/3 log segments. Stats: ops{read=9925 overwritten=0 applied=9923 ignored=0} inserts{seen=496100 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20260615 08:08:34.250401 13972 tablet_bootstrap.cc:492] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c: Bootstrap replayed 3/3 log segments. Stats: ops{read=14452 overwritten=6 applied=14446 ignored=2} inserts{seen=716751 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260615 08:08:34.250866 13972 tablet_bootstrap.cc:492] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c: Bootstrap complete.
I20260615 08:08:34.255775 13972 ts_tablet_manager.cc:1403] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c: Time spent bootstrapping tablet: real 2.079s user 1.803s sys 0.272s
I20260615 08:08:34.255944 13972 raft_consensus.cc:359] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 241 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:34.256039 13972 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 241 FOLLOWER]: Becoming Follower/Learner. State: Replica: b97b73a5f2ad444eb230680e3c3fcb6c, State: Initialized, Role: FOLLOWER
I20260615 08:08:34.256130 13972 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14446, Last appended: 240.14446, Last appended by leader: 14446, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:34.256325 13972 ts_tablet_manager.cc:1434] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c: Time spent starting tablet: real 0.000s user 0.002s sys 0.000s
I20260615 08:08:34.279539 14040 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 241 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:34.279614 14040 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 241 FOLLOWER]: Advancing to term 242
I20260615 08:08:34.280486 14040 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 242 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:34.280912 14040 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 242 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
W20260615 08:08:34.281414 13966 leader_election.cc:336] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 242 election: RPC error from VoteRequest() call to peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015): Network error: Client connection negotiation failed: client connection to 127.4.42.193:40015: connect: Connection refused (error 111)
W20260615 08:08:34.281510 13968 leader_election.cc:336] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 242 election: RPC error from VoteRequest() call to peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603): Network error: Client connection negotiation failed: client connection to 127.4.42.194:38603: connect: Connection refused (error 111)
I20260615 08:08:34.281571 13968 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 242 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:34.281635 14040 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 242 FOLLOWER]: Leader election lost for term 242. Reason: could not achieve majority
I20260615 08:08:34.314998 14040 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 242 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:34.315091 14040 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 242 FOLLOWER]: Advancing to term 243
I20260615 08:08:34.315838 14040 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 243 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:34.315996 14040 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 243 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
W20260615 08:08:34.316537 13966 leader_election.cc:336] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 243 election: RPC error from VoteRequest() call to peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015): Network error: Client connection negotiation failed: client connection to 127.4.42.193:40015: connect: Connection refused (error 111)
W20260615 08:08:34.316645 13968 leader_election.cc:336] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 243 election: RPC error from VoteRequest() call to peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603): Network error: Client connection negotiation failed: client connection to 127.4.42.194:38603: connect: Connection refused (error 111)
I20260615 08:08:34.316697 13968 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 243 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:34.316795 14040 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 243 FOLLOWER]: Leader election lost for term 243. Reason: could not achieve majority
I20260615 08:08:34.376430 14040 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 243 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:34.376513 14040 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 243 FOLLOWER]: Advancing to term 244
I20260615 08:08:34.377298 14040 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 244 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:34.377437 14040 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 244 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
W20260615 08:08:34.378042 13966 leader_election.cc:336] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 244 election: RPC error from VoteRequest() call to peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015): Network error: Client connection negotiation failed: client connection to 127.4.42.193:40015: connect: Connection refused (error 111)
W20260615 08:08:34.378098 13968 leader_election.cc:336] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 244 election: RPC error from VoteRequest() call to peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603): Network error: Client connection negotiation failed: client connection to 127.4.42.194:38603: connect: Connection refused (error 111)
I20260615 08:08:34.378156 13968 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 244 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:34.378232 14040 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 244 FOLLOWER]: Leader election lost for term 244. Reason: could not achieve majority
I20260615 08:08:34.388576 13816 tablet_bootstrap.cc:492] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1: Bootstrap replayed 2/4 log segments. Stats: ops{read=9261 overwritten=0 applied=9257 ignored=0} inserts{seen=462800 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 4 replicates
I20260615 08:08:34.472110 14040 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 244 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:34.472210 14040 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 244 FOLLOWER]: Advancing to term 245
I20260615 08:08:34.473116 14040 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 245 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:34.473281 14040 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 245 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
W20260615 08:08:34.474009 13966 leader_election.cc:336] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 245 election: RPC error from VoteRequest() call to peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015): Network error: Client connection negotiation failed: client connection to 127.4.42.193:40015: connect: Connection refused (error 111)
W20260615 08:08:34.474090 13968 leader_election.cc:336] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 245 election: RPC error from VoteRequest() call to peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603): Network error: Client connection negotiation failed: client connection to 127.4.42.194:38603: connect: Connection refused (error 111)
I20260615 08:08:34.474124 13968 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 245 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:34.474210 14040 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 245 FOLLOWER]: Leader election lost for term 245. Reason: could not achieve majority
I20260615 08:08:34.499260 13894 tablet_bootstrap.cc:492] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f: Bootstrap replayed 2/3 log segments. Stats: ops{read=9933 overwritten=0 applied=9931 ignored=0} inserts{seen=496500 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 2 replicates
I20260615 08:08:34.554872 14040 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 245 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:34.554982 14040 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 245 FOLLOWER]: Advancing to term 246
I20260615 08:08:34.555840 14040 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 246 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:34.556012 14040 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 246 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
W20260615 08:08:34.556702 13968 leader_election.cc:336] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 246 election: RPC error from VoteRequest() call to peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603): Network error: Client connection negotiation failed: client connection to 127.4.42.194:38603: connect: Connection refused (error 111)
W20260615 08:08:34.556768 13966 leader_election.cc:336] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 246 election: RPC error from VoteRequest() call to peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015): Network error: Client connection negotiation failed: client connection to 127.4.42.193:40015: connect: Connection refused (error 111)
I20260615 08:08:34.556828 13966 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 246 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:34.556927 14040 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 246 FOLLOWER]: Leader election lost for term 246. Reason: could not achieve majority
I20260615 08:08:34.728281 14040 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 246 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:34.728392 14040 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 246 FOLLOWER]: Advancing to term 247
I20260615 08:08:34.729252 14040 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 247 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:34.729638 14040 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 247 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
W20260615 08:08:34.730139 13968 leader_election.cc:336] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 247 election: RPC error from VoteRequest() call to peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603): Network error: Client connection negotiation failed: client connection to 127.4.42.194:38603: connect: Connection refused (error 111)
W20260615 08:08:34.730216 13966 leader_election.cc:336] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 247 election: RPC error from VoteRequest() call to peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015): Network error: Client connection negotiation failed: client connection to 127.4.42.193:40015: connect: Connection refused (error 111)
I20260615 08:08:34.730247 13966 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 247 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:34.730335 14040 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 247 FOLLOWER]: Leader election lost for term 247. Reason: could not achieve majority
I20260615 08:08:34.831220 14040 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 247 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:34.831321 14040 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 247 FOLLOWER]: Advancing to term 248
I20260615 08:08:34.832191 14040 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 248 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:34.832567 14040 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 248 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
W20260615 08:08:34.833094 13966 leader_election.cc:336] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 248 election: RPC error from VoteRequest() call to peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015): Network error: Client connection negotiation failed: client connection to 127.4.42.193:40015: connect: Connection refused (error 111)
W20260615 08:08:34.833176 13968 leader_election.cc:336] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 248 election: RPC error from VoteRequest() call to peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603): Network error: Client connection negotiation failed: client connection to 127.4.42.194:38603: connect: Connection refused (error 111)
I20260615 08:08:34.833209 13968 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 248 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:34.833283 14040 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 248 FOLLOWER]: Leader election lost for term 248. Reason: could not achieve majority
I20260615 08:08:35.070843 13816 tablet_bootstrap.cc:492] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1: Bootstrap replayed 3/4 log segments. Stats: ops{read=13891 overwritten=0 applied=13888 ignored=0} inserts{seen=694350 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 3 replicates
I20260615 08:08:35.128461 14040 raft_consensus.cc:493] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 248 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:35.128575 14040 raft_consensus.cc:3060] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 248 FOLLOWER]: Advancing to term 249
I20260615 08:08:35.129410 14040 raft_consensus.cc:515] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 249 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:35.129606 14040 leader_election.cc:290] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 249 election: Requested vote from peers 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015), d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603)
W20260615 08:08:35.130431 13968 leader_election.cc:336] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 249 election: RPC error from VoteRequest() call to peer d4d7c2ebbf334b19a7f964aab04f280f (127.4.42.194:38603): Network error: Client connection negotiation failed: client connection to 127.4.42.194:38603: connect: Connection refused (error 111)
W20260615 08:08:35.130527 13966 leader_election.cc:336] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 249 election: RPC error from VoteRequest() call to peer 666bbeda390e4798abb1630585e244a1 (127.4.42.193:40015): Network error: Client connection negotiation failed: client connection to 127.4.42.193:40015: connect: Connection refused (error 111)
I20260615 08:08:35.130563 13966 leader_election.cc:304] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [CANDIDATE]: Term 249 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b97b73a5f2ad444eb230680e3c3fcb6c; no voters: 666bbeda390e4798abb1630585e244a1, d4d7c2ebbf334b19a7f964aab04f280f
I20260615 08:08:35.130676 14040 raft_consensus.cc:2749] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 249 FOLLOWER]: Leader election lost for term 249. Reason: could not achieve majority
I20260615 08:08:35.141324 13816 tablet_bootstrap.cc:492] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1: Bootstrap replayed 4/4 log segments. Stats: ops{read=14456 overwritten=10 applied=14446 ignored=2} inserts{seen=716751 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260615 08:08:35.141742 13816 tablet_bootstrap.cc:492] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1: Bootstrap complete.
I20260615 08:08:35.142187 13894 tablet_bootstrap.cc:492] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f: Bootstrap replayed 3/3 log segments. Stats: ops{read=14451 overwritten=5 applied=14446 ignored=2} inserts{seen=716751 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260615 08:08:35.142597 13894 tablet_bootstrap.cc:492] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f: Bootstrap complete.
I20260615 08:08:35.147387 13816 ts_tablet_manager.cc:1403] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1: Time spent bootstrapping tablet: real 3.020s user 2.626s sys 0.392s
I20260615 08:08:35.147541 13816 raft_consensus.cc:359] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 240 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:35.147612 13816 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 240 FOLLOWER]: Becoming Follower/Learner. State: Replica: 666bbeda390e4798abb1630585e244a1, State: Initialized, Role: FOLLOWER
I20260615 08:08:35.147676 13816 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14446, Last appended: 240.14446, Last appended by leader: 14446, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:35.147748 13894 ts_tablet_manager.cc:1403] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f: Time spent bootstrapping tablet: real 3.000s user 2.609s sys 0.388s
I20260615 08:08:35.147850 13816 ts_tablet_manager.cc:1434] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260615 08:08:35.147890 13894 raft_consensus.cc:359] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 241 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:35.147993 13894 raft_consensus.cc:740] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 241 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4d7c2ebbf334b19a7f964aab04f280f, State: Initialized, Role: FOLLOWER
I20260615 08:08:35.148053 13894 consensus_queue.cc:260] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14446, Last appended: 240.14446, Last appended by leader: 14446, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "666bbeda390e4798abb1630585e244a1" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 40015 } } peers { permanent_uuid: "d4d7c2ebbf334b19a7f964aab04f280f" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38603 } } peers { permanent_uuid: "b97b73a5f2ad444eb230680e3c3fcb6c" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 40159 } }
I20260615 08:08:35.148238 13894 ts_tablet_manager.cc:1434] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260615 08:08:35.148411 4267 tablet_server.cc:179] TabletServer@127.4.42.193:0 shutting down...
I20260615 08:08:35.150835 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:08:35.151012 4267 tablet_replica.cc:333] stopping tablet replica
I20260615 08:08:35.151072 4267 raft_consensus.cc:2243] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 240 FOLLOWER]: Raft consensus shutting down.
I20260615 08:08:35.151122 4267 raft_consensus.cc:2272] T ad08259deddd40febcaca9a4ceb302d4 P 666bbeda390e4798abb1630585e244a1 [term 240 FOLLOWER]: Raft consensus is shut down!
W20260615 08:08:35.153548 4267 mvcc.cc:118] aborting op with timestamp 7297068646610063360 in state 0; MVCC is closed
I20260615 08:08:35.164867 4267 tablet_server.cc:196] TabletServer@127.4.42.193:0 shutdown complete.
I20260615 08:08:35.165688 4267 tablet_server.cc:179] TabletServer@127.4.42.194:0 shutting down...
I20260615 08:08:35.169091 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:08:35.169229 4267 tablet_replica.cc:333] stopping tablet replica
I20260615 08:08:35.169304 4267 raft_consensus.cc:2243] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 241 FOLLOWER]: Raft consensus shutting down.
I20260615 08:08:35.169358 4267 raft_consensus.cc:2272] T ad08259deddd40febcaca9a4ceb302d4 P d4d7c2ebbf334b19a7f964aab04f280f [term 241 FOLLOWER]: Raft consensus is shut down!
W20260615 08:08:35.181037 4267 mvcc.cc:118] aborting op with timestamp 7297068646610063360 in state 0; MVCC is closed
I20260615 08:08:35.192709 4267 tablet_server.cc:196] TabletServer@127.4.42.194:0 shutdown complete.
I20260615 08:08:35.193552 4267 tablet_server.cc:179] TabletServer@127.4.42.195:0 shutting down...
I20260615 08:08:35.196026 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:08:35.196136 4267 tablet_replica.cc:333] stopping tablet replica
I20260615 08:08:35.196192 4267 raft_consensus.cc:2243] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 249 FOLLOWER]: Raft consensus shutting down.
I20260615 08:08:35.196228 4267 raft_consensus.cc:2272] T ad08259deddd40febcaca9a4ceb302d4 P b97b73a5f2ad444eb230680e3c3fcb6c [term 249 FOLLOWER]: Raft consensus is shut down!
W20260615 08:08:35.198401 4267 mvcc.cc:118] aborting op with timestamp 7297068646610063360 in state 0; MVCC is closed
I20260615 08:08:35.210211 4267 tablet_server.cc:196] TabletServer@127.4.42.195:0 shutdown complete.
I20260615 08:08:35.211017 4267 master.cc:562] Master@127.4.42.254:37165 shutting down...
I20260615 08:08:35.213168 4267 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [term 2 LEADER]: Raft consensus shutting down.
I20260615 08:08:35.213219 4267 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 57150f4ea2c148f886adbfcf490def0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:08:35.213236 4267 tablet_replica.cc:333] stopping tablet replica
I20260615 08:08:35.224416 4267 master.cc:584] Master@127.4.42.254:37165 shutdown complete.
[ OK ] TxnParticipantElectionStormITest.TestFrequentElections (25850 ms)
[ RUN ] TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm
I20260615 08:08:35.244644 4267 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.42.254:42685
I20260615 08:08:35.244787 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:08:35.245862 14051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:08:35.245886 14052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:08:35.245942 14054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:08:35.246115 4267 server_base.cc:1061] running on GCE node
I20260615 08:08:35.246209 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:08:35.246237 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:08:35.246249 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510915246250 us; error 0 us; skew 500 ppm
I20260615 08:08:35.246791 4267 webserver.cc:533] Webserver started at http://127.4.42.254:35593/ using document root <none> and password file <none>
I20260615 08:08:35.246881 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:08:35.246943 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:08:35.247011 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:08:35.247311 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1781510637089012-4267-0/minicluster-data/master-0-root/instance:
uuid: "7de681fa62de4d4581753289ce8dfd38"
format_stamp: "Formatted at 2026-06-15 08:08:35 on dist-test-slave-37n8"
I20260615 08:08:35.248234 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:08:35.248693 14059 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:35.248822 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:35.248869 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1781510637089012-4267-0/minicluster-data/master-0-root
uuid: "7de681fa62de4d4581753289ce8dfd38"
format_stamp: "Formatted at 2026-06-15 08:08:35 on dist-test-slave-37n8"
I20260615 08:08:35.248896 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1781510637089012-4267-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1781510637089012-4267-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1781510637089012-4267-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:08:35.280416 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:08:35.280596 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:08:35.283244 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.254:42685
I20260615 08:08:35.288518 14111 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.254:42685 every 8 connection(s)
I20260615 08:08:35.292718 14112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:08:35.294210 14112 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7de681fa62de4d4581753289ce8dfd38: Bootstrap starting.
I20260615 08:08:35.294530 14112 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7de681fa62de4d4581753289ce8dfd38: Neither blocks nor log segments found. Creating new log.
I20260615 08:08:35.295020 14112 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7de681fa62de4d4581753289ce8dfd38: No bootstrap required, opened a new log
I20260615 08:08:35.295159 14112 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7de681fa62de4d4581753289ce8dfd38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7de681fa62de4d4581753289ce8dfd38" member_type: VOTER }
I20260615 08:08:35.295221 14112 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7de681fa62de4d4581753289ce8dfd38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:08:35.295254 14112 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7de681fa62de4d4581753289ce8dfd38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7de681fa62de4d4581753289ce8dfd38, State: Initialized, Role: FOLLOWER
I20260615 08:08:35.295308 14112 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7de681fa62de4d4581753289ce8dfd38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7de681fa62de4d4581753289ce8dfd38" member_type: VOTER }
I20260615 08:08:35.295346 14112 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7de681fa62de4d4581753289ce8dfd38 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260615 08:08:35.295373 14112 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7de681fa62de4d4581753289ce8dfd38 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260615 08:08:35.295403 14112 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7de681fa62de4d4581753289ce8dfd38 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:08:35.295871 14112 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7de681fa62de4d4581753289ce8dfd38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7de681fa62de4d4581753289ce8dfd38" member_type: VOTER }
I20260615 08:08:35.295946 14112 leader_election.cc:304] T 00000000000000000000000000000000 P 7de681fa62de4d4581753289ce8dfd38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7de681fa62de4d4581753289ce8dfd38; no voters:
I20260615 08:08:35.296070 14112 leader_election.cc:290] T 00000000000000000000000000000000 P 7de681fa62de4d4581753289ce8dfd38 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260615 08:08:35.296116 14115 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7de681fa62de4d4581753289ce8dfd38 [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:08:35.296226 14112 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7de681fa62de4d4581753289ce8dfd38 [sys.catalog]: configured and running, proceeding with master startup.
I20260615 08:08:35.296339 14115 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7de681fa62de4d4581753289ce8dfd38 [term 1 LEADER]: Becoming Leader. State: Replica: 7de681fa62de4d4581753289ce8dfd38, State: Running, Role: LEADER
I20260615 08:08:35.296412 14115 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7de681fa62de4d4581753289ce8dfd38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7de681fa62de4d4581753289ce8dfd38" member_type: VOTER }
I20260615 08:08:35.296656 14116 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7de681fa62de4d4581753289ce8dfd38 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7de681fa62de4d4581753289ce8dfd38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7de681fa62de4d4581753289ce8dfd38" member_type: VOTER } }
I20260615 08:08:35.296666 14117 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7de681fa62de4d4581753289ce8dfd38 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7de681fa62de4d4581753289ce8dfd38. Latest consensus state: current_term: 1 leader_uuid: "7de681fa62de4d4581753289ce8dfd38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7de681fa62de4d4581753289ce8dfd38" member_type: VOTER } }
I20260615 08:08:35.296752 14116 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7de681fa62de4d4581753289ce8dfd38 [sys.catalog]: This master's current role is: LEADER
I20260615 08:08:35.296765 14117 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7de681fa62de4d4581753289ce8dfd38 [sys.catalog]: This master's current role is: LEADER
I20260615 08:08:35.296981 14122 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260615 08:08:35.297118 14122 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260615 08:08:35.297675 4267 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260615 08:08:35.297744 14122 catalog_manager.cc:1382] Generated new cluster ID: 8d879d0f480f48aaa0f071b773d802e4
I20260615 08:08:35.297808 14122 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260615 08:08:35.318265 14122 catalog_manager.cc:1405] Generated new certificate authority record
I20260615 08:08:35.318763 14122 catalog_manager.cc:1539] Loading token signing keys...
I20260615 08:08:35.329821 14122 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 7de681fa62de4d4581753289ce8dfd38: Generated new TSK 0
I20260615 08:08:35.329903 14122 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260615 08:08:35.361631 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260615 08:08:35.361799 4267 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 15
W20260615 08:08:35.363150 14134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:08:35.363098 14133 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:08:35.363137 14136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:08:35.363301 4267 server_base.cc:1061] running on GCE node
I20260615 08:08:35.363477 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:08:35.363509 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:08:35.363523 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510915363523 us; error 0 us; skew 500 ppm
I20260615 08:08:35.364061 4267 webserver.cc:533] Webserver started at http://127.4.42.193:40263/ using document root <none> and password file <none>
I20260615 08:08:35.364131 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:08:35.364158 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:08:35.364198 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:08:35.364442 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1781510637089012-4267-0/minicluster-data/ts-0-root/instance:
uuid: "e5f18c39377a41478b22da5e348c4181"
format_stamp: "Formatted at 2026-06-15 08:08:35 on dist-test-slave-37n8"
I20260615 08:08:35.365372 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:08:35.365797 14141 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:35.365993 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:35.366034 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1781510637089012-4267-0/minicluster-data/ts-0-root
uuid: "e5f18c39377a41478b22da5e348c4181"
format_stamp: "Formatted at 2026-06-15 08:08:35 on dist-test-slave-37n8"
I20260615 08:08:35.366062 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1781510637089012-4267-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1781510637089012-4267-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1781510637089012-4267-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:08:35.376365 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:08:35.376534 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:08:35.376642 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:08:35.376854 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:08:35.376880 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:35.376899 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:08:35.376940 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:35.379714 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.193:39447
I20260615 08:08:35.379745 14204 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.193:39447 every 8 connection(s)
I20260615 08:08:35.380090 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260615 08:08:35.380231 4267 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 15
W20260615 08:08:35.381222 14209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:08:35.381280 14210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:08:35.381666 14212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:08:35.381703 4267 server_base.cc:1061] running on GCE node
I20260615 08:08:35.381853 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:08:35.381884 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:08:35.381901 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510915381902 us; error 0 us; skew 500 ppm
I20260615 08:08:35.382642 4267 webserver.cc:533] Webserver started at http://127.4.42.194:39201/ using document root <none> and password file <none>
I20260615 08:08:35.382733 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:08:35.382779 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:08:35.382825 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:08:35.383083 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1781510637089012-4267-0/minicluster-data/ts-1-root/instance:
uuid: "c65a2ff8f6a2488cbca18298161bf04b"
format_stamp: "Formatted at 2026-06-15 08:08:35 on dist-test-slave-37n8"
I20260615 08:08:35.384038 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:08:35.384505 14217 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:35.384641 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:35.384697 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1781510637089012-4267-0/minicluster-data/ts-1-root
uuid: "c65a2ff8f6a2488cbca18298161bf04b"
format_stamp: "Formatted at 2026-06-15 08:08:35 on dist-test-slave-37n8"
I20260615 08:08:35.384747 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1781510637089012-4267-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1781510637089012-4267-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1781510637089012-4267-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:08:35.387955 14205 heartbeater.cc:344] Connected to a master server at 127.4.42.254:42685
I20260615 08:08:35.388010 14205 heartbeater.cc:461] Registering TS with master...
I20260615 08:08:35.388121 14205 heartbeater.cc:507] Master 127.4.42.254:42685 requested a full tablet report, sending...
I20260615 08:08:35.388360 14076 ts_manager.cc:194] Registered new tserver with Master: e5f18c39377a41478b22da5e348c4181 (127.4.42.193:39447)
I20260615 08:08:35.388913 14076 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52538
I20260615 08:08:35.401451 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:08:35.401638 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:08:35.401791 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:08:35.401981 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:08:35.402029 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:35.402067 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:08:35.402094 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:35.405074 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.194:42381
I20260615 08:08:35.405104 14280 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.194:42381 every 8 connection(s)
I20260615 08:08:35.405448 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260615 08:08:35.405567 4267 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 15
W20260615 08:08:35.406529 14284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:08:35.406687 14285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:08:35.406824 14287 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:08:35.406911 4267 server_base.cc:1061] running on GCE node
I20260615 08:08:35.407033 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:08:35.407058 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:08:35.407070 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510915407071 us; error 0 us; skew 500 ppm
I20260615 08:08:35.407605 4267 webserver.cc:533] Webserver started at http://127.4.42.195:36515/ using document root <none> and password file <none>
I20260615 08:08:35.407697 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:08:35.407744 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:08:35.407789 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:08:35.408116 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1781510637089012-4267-0/minicluster-data/ts-2-root/instance:
uuid: "6ea252efaec54c80a4eaa27683b3f4a1"
format_stamp: "Formatted at 2026-06-15 08:08:35 on dist-test-slave-37n8"
I20260615 08:08:35.408870 14281 heartbeater.cc:344] Connected to a master server at 127.4.42.254:42685
I20260615 08:08:35.408942 14281 heartbeater.cc:461] Registering TS with master...
I20260615 08:08:35.409065 14281 heartbeater.cc:507] Master 127.4.42.254:42685 requested a full tablet report, sending...
I20260615 08:08:35.409304 14076 ts_manager.cc:194] Registered new tserver with Master: c65a2ff8f6a2488cbca18298161bf04b (127.4.42.194:42381)
I20260615 08:08:35.409307 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260615 08:08:35.409803 14076 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52552
I20260615 08:08:35.409868 14292 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:35.410022 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:35.410060 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1781510637089012-4267-0/minicluster-data/ts-2-root
uuid: "6ea252efaec54c80a4eaa27683b3f4a1"
format_stamp: "Formatted at 2026-06-15 08:08:35 on dist-test-slave-37n8"
I20260615 08:08:35.410125 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1781510637089012-4267-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1781510637089012-4267-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm.1781510637089012-4267-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:08:35.424690 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:08:35.424912 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:08:35.425073 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:08:35.425278 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:08:35.425321 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:35.425360 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:08:35.425387 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:35.428628 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.195:39511
I20260615 08:08:35.428690 14355 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.195:39511 every 8 connection(s)
I20260615 08:08:35.431788 14356 heartbeater.cc:344] Connected to a master server at 127.4.42.254:42685
I20260615 08:08:35.431841 14356 heartbeater.cc:461] Registering TS with master...
I20260615 08:08:35.431911 14356 heartbeater.cc:507] Master 127.4.42.254:42685 requested a full tablet report, sending...
I20260615 08:08:35.432209 14076 ts_manager.cc:194] Registered new tserver with Master: 6ea252efaec54c80a4eaa27683b3f4a1 (127.4.42.195:39511)
I20260615 08:08:35.432507 14076 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52564
I20260615 08:08:35.433238 4267 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.00440582s
I20260615 08:08:35.438069 14076 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52580:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260615 08:08:35.438215 14076 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260615 08:08:35.442714 14245 tablet_service.cc:1511] Processing CreateTablet for tablet 78bb810d7b6f47c282840d08acc6c470 (DEFAULT_TABLE table=test-workload [id=55dfdb764aac444f90b01d5517645af0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:08:35.442839 14245 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78bb810d7b6f47c282840d08acc6c470. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:08:35.443377 14169 tablet_service.cc:1511] Processing CreateTablet for tablet 78bb810d7b6f47c282840d08acc6c470 (DEFAULT_TABLE table=test-workload [id=55dfdb764aac444f90b01d5517645af0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:08:35.443468 14169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78bb810d7b6f47c282840d08acc6c470. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:08:35.444242 14371 tablet_bootstrap.cc:492] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b: Bootstrap starting.
I20260615 08:08:35.444315 14320 tablet_service.cc:1511] Processing CreateTablet for tablet 78bb810d7b6f47c282840d08acc6c470 (DEFAULT_TABLE table=test-workload [id=55dfdb764aac444f90b01d5517645af0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:08:35.444422 14320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78bb810d7b6f47c282840d08acc6c470. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:08:35.444689 14371 tablet_bootstrap.cc:654] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b: Neither blocks nor log segments found. Creating new log.
I20260615 08:08:35.444826 14372 tablet_bootstrap.cc:492] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181: Bootstrap starting.
I20260615 08:08:35.445304 14372 tablet_bootstrap.cc:654] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181: Neither blocks nor log segments found. Creating new log.
I20260615 08:08:35.445483 14371 tablet_bootstrap.cc:492] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b: No bootstrap required, opened a new log
I20260615 08:08:35.445533 14371 ts_tablet_manager.cc:1403] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:08:35.445695 14371 raft_consensus.cc:359] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } }
I20260615 08:08:35.445779 14371 raft_consensus.cc:385] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:08:35.445817 14371 raft_consensus.cc:740] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c65a2ff8f6a2488cbca18298161bf04b, State: Initialized, Role: FOLLOWER
I20260615 08:08:35.445871 14371 consensus_queue.cc:260] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } }
I20260615 08:08:35.445972 14372 tablet_bootstrap.cc:492] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181: No bootstrap required, opened a new log
I20260615 08:08:35.446041 14372 ts_tablet_manager.cc:1403] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:08:35.446054 14281 heartbeater.cc:499] Master 127.4.42.254:42685 was elected leader, sending a full tablet report...
I20260615 08:08:35.446031 14371 ts_tablet_manager.cc:1434] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260615 08:08:35.446225 14375 tablet_bootstrap.cc:492] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1: Bootstrap starting.
I20260615 08:08:35.446317 14372 raft_consensus.cc:359] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } }
I20260615 08:08:35.446393 14372 raft_consensus.cc:385] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:08:35.446460 14372 raft_consensus.cc:740] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5f18c39377a41478b22da5e348c4181, State: Initialized, Role: FOLLOWER
I20260615 08:08:35.446643 14372 consensus_queue.cc:260] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } }
I20260615 08:08:35.446771 14375 tablet_bootstrap.cc:654] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1: Neither blocks nor log segments found. Creating new log.
I20260615 08:08:35.446801 14372 ts_tablet_manager.cc:1434] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:08:35.446920 14205 heartbeater.cc:499] Master 127.4.42.254:42685 was elected leader, sending a full tablet report...
I20260615 08:08:35.447419 14375 tablet_bootstrap.cc:492] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1: No bootstrap required, opened a new log
I20260615 08:08:35.447470 14375 ts_tablet_manager.cc:1403] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:08:35.447610 14375 raft_consensus.cc:359] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } }
I20260615 08:08:35.447652 14375 raft_consensus.cc:385] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:08:35.447685 14375 raft_consensus.cc:740] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ea252efaec54c80a4eaa27683b3f4a1, State: Initialized, Role: FOLLOWER
I20260615 08:08:35.447751 14375 consensus_queue.cc:260] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } }
I20260615 08:08:35.447947 14375 ts_tablet_manager.cc:1434] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260615 08:08:35.447962 14356 heartbeater.cc:499] Master 127.4.42.254:42685 was elected leader, sending a full tablet report...
I20260615 08:08:35.450024 14376 raft_consensus.cc:493] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260615 08:08:35.450073 14376 raft_consensus.cc:515] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } }
I20260615 08:08:35.450225 14376 leader_election.cc:290] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ea252efaec54c80a4eaa27683b3f4a1 (127.4.42.195:39511), e5f18c39377a41478b22da5e348c4181 (127.4.42.193:39447)
I20260615 08:08:35.452704 14179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bb810d7b6f47c282840d08acc6c470" candidate_uuid: "c65a2ff8f6a2488cbca18298161bf04b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f18c39377a41478b22da5e348c4181" is_pre_election: true
I20260615 08:08:35.452782 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bb810d7b6f47c282840d08acc6c470" candidate_uuid: "c65a2ff8f6a2488cbca18298161bf04b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" is_pre_election: true
I20260615 08:08:35.452795 14179 raft_consensus.cc:2468] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65a2ff8f6a2488cbca18298161bf04b in term 0.
I20260615 08:08:35.452893 14330 raft_consensus.cc:2468] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65a2ff8f6a2488cbca18298161bf04b in term 0.
I20260615 08:08:35.453013 14218 leader_election.cc:304] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c65a2ff8f6a2488cbca18298161bf04b, e5f18c39377a41478b22da5e348c4181; no voters:
I20260615 08:08:35.453109 14376 raft_consensus.cc:2804] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260615 08:08:35.453151 14376 raft_consensus.cc:493] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:35.453177 14376 raft_consensus.cc:3060] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:08:35.453675 14376 raft_consensus.cc:515] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } }
I20260615 08:08:35.453801 14376 leader_election.cc:290] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [CANDIDATE]: Term 1 election: Requested vote from peers 6ea252efaec54c80a4eaa27683b3f4a1 (127.4.42.195:39511), e5f18c39377a41478b22da5e348c4181 (127.4.42.193:39447)
I20260615 08:08:35.453905 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bb810d7b6f47c282840d08acc6c470" candidate_uuid: "c65a2ff8f6a2488cbca18298161bf04b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ea252efaec54c80a4eaa27683b3f4a1"
I20260615 08:08:35.453905 14179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bb810d7b6f47c282840d08acc6c470" candidate_uuid: "c65a2ff8f6a2488cbca18298161bf04b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5f18c39377a41478b22da5e348c4181"
I20260615 08:08:35.453995 14330 raft_consensus.cc:3060] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:08:35.454002 14179 raft_consensus.cc:3060] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:08:35.454695 14330 raft_consensus.cc:2468] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65a2ff8f6a2488cbca18298161bf04b in term 1.
I20260615 08:08:35.454696 14179 raft_consensus.cc:2468] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65a2ff8f6a2488cbca18298161bf04b in term 1.
I20260615 08:08:35.454871 14220 leader_election.cc:304] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ea252efaec54c80a4eaa27683b3f4a1, c65a2ff8f6a2488cbca18298161bf04b; no voters:
I20260615 08:08:35.454993 14376 raft_consensus.cc:2804] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:08:35.455122 14376 raft_consensus.cc:697] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 1 LEADER]: Becoming Leader. State: Replica: c65a2ff8f6a2488cbca18298161bf04b, State: Running, Role: LEADER
I20260615 08:08:35.455174 14376 consensus_queue.cc:237] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } }
I20260615 08:08:35.455665 14076 catalog_manager.cc:5696] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b reported cstate change: term changed from 0 to 1, leader changed from <none> to c65a2ff8f6a2488cbca18298161bf04b (127.4.42.194). New cstate: current_term: 1 leader_uuid: "c65a2ff8f6a2488cbca18298161bf04b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:35.470739 14179 raft_consensus.cc:1275] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 1 FOLLOWER]: Refusing update from remote peer c65a2ff8f6a2488cbca18298161bf04b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:08:35.470759 14330 raft_consensus.cc:1275] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 1 FOLLOWER]: Refusing update from remote peer c65a2ff8f6a2488cbca18298161bf04b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:08:35.470924 14381 consensus_queue.cc:1048] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:08:35.471005 14376 consensus_queue.cc:1048] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:08:45.497545 14433 raft_consensus.cc:493] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c65a2ff8f6a2488cbca18298161bf04b)
I20260615 08:08:45.497613 14433 raft_consensus.cc:3060] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:08:45.498282 14433 raft_consensus.cc:515] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } }
I20260615 08:08:45.498508 14433 leader_election.cc:290] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [CANDIDATE]: Term 2 election: Requested vote from peers c65a2ff8f6a2488cbca18298161bf04b (127.4.42.194:42381), e5f18c39377a41478b22da5e348c4181 (127.4.42.193:39447)
I20260615 08:08:45.501106 14179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bb810d7b6f47c282840d08acc6c470" candidate_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 14159 } } ignore_live_leader: false dest_uuid: "e5f18c39377a41478b22da5e348c4181"
I20260615 08:08:45.501152 14255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bb810d7b6f47c282840d08acc6c470" candidate_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" candidate_term: 2 candidate_status { last_received { term: 1 index: 14159 } } ignore_live_leader: false dest_uuid: "c65a2ff8f6a2488cbca18298161bf04b"
I20260615 08:08:45.501360 14294 leader_election.cc:304] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ea252efaec54c80a4eaa27683b3f4a1; no voters: c65a2ff8f6a2488cbca18298161bf04b, e5f18c39377a41478b22da5e348c4181
I20260615 08:08:45.501461 14433 raft_consensus.cc:2749] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260615 08:08:45.503628 14329 raft_consensus.cc:1240] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 2 FOLLOWER]: Rejecting Update request from peer c65a2ff8f6a2488cbca18298161bf04b for earlier term 1. Current term is 2. Ops: []
I20260615 08:08:45.503870 14405 consensus_queue.cc:1059] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 }, Status: INVALID_TERM, Last received: 1.14159, Next index: 14160, Last known committed idx: 14159, Time since last communication: 0.000s
I20260615 08:08:45.512100 14405 raft_consensus.cc:3055] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 1 LEADER]: Stepping down as leader of term 1
I20260615 08:08:45.512171 14405 raft_consensus.cc:740] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c65a2ff8f6a2488cbca18298161bf04b, State: Running, Role: LEADER
I20260615 08:08:45.512236 14405 consensus_queue.cc:260] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14159, Committed index: 14159, Last appended: 1.14159, Last appended by leader: 14159, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } }
I20260615 08:08:45.512344 14405 raft_consensus.cc:3060] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:08:45.525803 14438 raft_consensus.cc:493] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c65a2ff8f6a2488cbca18298161bf04b)
I20260615 08:08:45.525861 14438 raft_consensus.cc:3060] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:08:45.526582 14438 raft_consensus.cc:515] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } }
I20260615 08:08:45.526767 14438 leader_election.cc:290] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [CANDIDATE]: Term 2 election: Requested vote from peers 6ea252efaec54c80a4eaa27683b3f4a1 (127.4.42.195:39511), c65a2ff8f6a2488cbca18298161bf04b (127.4.42.194:42381)
I20260615 08:08:45.530216 14255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bb810d7b6f47c282840d08acc6c470" candidate_uuid: "e5f18c39377a41478b22da5e348c4181" candidate_term: 2 candidate_status { last_received { term: 1 index: 14159 } } ignore_live_leader: false dest_uuid: "c65a2ff8f6a2488cbca18298161bf04b"
I20260615 08:08:45.530215 14329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bb810d7b6f47c282840d08acc6c470" candidate_uuid: "e5f18c39377a41478b22da5e348c4181" candidate_term: 2 candidate_status { last_received { term: 1 index: 14159 } } ignore_live_leader: false dest_uuid: "6ea252efaec54c80a4eaa27683b3f4a1"
I20260615 08:08:45.530347 14329 raft_consensus.cc:2393] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f18c39377a41478b22da5e348c4181 in current term 2: Already voted for candidate 6ea252efaec54c80a4eaa27683b3f4a1 in this term.
I20260615 08:08:45.530920 14255 raft_consensus.cc:2468] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f18c39377a41478b22da5e348c4181 in term 2.
I20260615 08:08:45.531121 14143 leader_election.cc:304] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c65a2ff8f6a2488cbca18298161bf04b, e5f18c39377a41478b22da5e348c4181; no voters: 6ea252efaec54c80a4eaa27683b3f4a1
I20260615 08:08:45.531219 14438 raft_consensus.cc:2804] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 2 FOLLOWER]: Leader election won for term 2
I20260615 08:08:45.531363 14438 raft_consensus.cc:697] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 2 LEADER]: Becoming Leader. State: Replica: e5f18c39377a41478b22da5e348c4181, State: Running, Role: LEADER
I20260615 08:08:45.531440 14438 consensus_queue.cc:237] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14159, Committed index: 14159, Last appended: 1.14159, Last appended by leader: 14159, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } }
I20260615 08:08:45.531848 14076 catalog_manager.cc:5696] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 reported cstate change: term changed from 1 to 2, leader changed from c65a2ff8f6a2488cbca18298161bf04b (127.4.42.194) to e5f18c39377a41478b22da5e348c4181 (127.4.42.193). New cstate: current_term: 2 leader_uuid: "e5f18c39377a41478b22da5e348c4181" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:45.532872 14433 raft_consensus.cc:493] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:45.532917 14433 raft_consensus.cc:3060] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 2 FOLLOWER]: Advancing to term 3
I20260615 08:08:45.533401 14433 raft_consensus.cc:515] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } }
I20260615 08:08:45.533538 14433 leader_election.cc:290] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [CANDIDATE]: Term 3 election: Requested vote from peers c65a2ff8f6a2488cbca18298161bf04b (127.4.42.194:42381), e5f18c39377a41478b22da5e348c4181 (127.4.42.193:39447)
I20260615 08:08:45.533675 14255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bb810d7b6f47c282840d08acc6c470" candidate_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" candidate_term: 3 candidate_status { last_received { term: 1 index: 14159 } } ignore_live_leader: false dest_uuid: "c65a2ff8f6a2488cbca18298161bf04b"
I20260615 08:08:45.533671 14179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bb810d7b6f47c282840d08acc6c470" candidate_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" candidate_term: 3 candidate_status { last_received { term: 1 index: 14159 } } ignore_live_leader: false dest_uuid: "e5f18c39377a41478b22da5e348c4181"
I20260615 08:08:45.533753 14255 raft_consensus.cc:3060] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 2 FOLLOWER]: Advancing to term 3
I20260615 08:08:45.534305 14255 raft_consensus.cc:2468] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ea252efaec54c80a4eaa27683b3f4a1 in term 3.
I20260615 08:08:45.534479 14294 leader_election.cc:304] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ea252efaec54c80a4eaa27683b3f4a1, c65a2ff8f6a2488cbca18298161bf04b; no voters: e5f18c39377a41478b22da5e348c4181
I20260615 08:08:45.534610 14433 raft_consensus.cc:2804] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 3 FOLLOWER]: Leader election won for term 3
I20260615 08:08:45.534726 14433 raft_consensus.cc:697] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 3 LEADER]: Becoming Leader. State: Replica: 6ea252efaec54c80a4eaa27683b3f4a1, State: Running, Role: LEADER
I20260615 08:08:45.534765 14433 consensus_queue.cc:237] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14159, Committed index: 14159, Last appended: 1.14159, Last appended by leader: 14159, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } }
W20260615 08:08:45.538107 14245 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:50126: Illegal state: replica c65a2ff8f6a2488cbca18298161bf04b is not leader of this config: current role FOLLOWER
I20260615 08:08:45.545082 14179 raft_consensus.cc:3055] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 2 LEADER]: Stepping down as leader of term 2
I20260615 08:08:45.545140 14179 raft_consensus.cc:740] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e5f18c39377a41478b22da5e348c4181, State: Running, Role: LEADER
I20260615 08:08:45.545200 14179 consensus_queue.cc:260] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14159, Committed index: 14159, Last appended: 2.14160, Last appended by leader: 14160, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } }
I20260615 08:08:45.545251 14255 raft_consensus.cc:1275] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 3 FOLLOWER]: Refusing update from remote peer 6ea252efaec54c80a4eaa27683b3f4a1: Log matching property violated. Preceding OpId in replica: term: 1 index: 14159. Preceding OpId from leader: term: 3 index: 14161. (index mismatch)
I20260615 08:08:45.545261 14179 raft_consensus.cc:3060] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 2 FOLLOWER]: Advancing to term 3
I20260615 08:08:45.545459 14446 consensus_queue.cc:1048] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14160, Last known committed idx: 14159, Time since last communication: 0.000s
I20260615 08:08:45.546025 14179 raft_consensus.cc:1275] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 3 FOLLOWER]: Refusing update from remote peer 6ea252efaec54c80a4eaa27683b3f4a1: Log matching property violated. Preceding OpId in replica: term: 2 index: 14160. Preceding OpId from leader: term: 3 index: 14161. (index mismatch)
I20260615 08:08:45.546257 14446 consensus_queue.cc:1048] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14160, Last known committed idx: 14159, Time since last communication: 0.000s
I20260615 08:08:45.546372 14446 consensus_queue.cc:1243] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [LEADER]: Peer e5f18c39377a41478b22da5e348c4181 log is divergent from this leader: its last log entry 2.14160 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14159
I20260615 08:08:45.546557 14179 pending_rounds.cc:85] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181: Aborting all ops after (but not including) 14159
I20260615 08:08:45.546599 14179 pending_rounds.cc:107] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181: Aborting uncommitted NO_OP operation due to leader change: 2.14160
I20260615 08:08:45.546627 14179 raft_consensus.cc:2889] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260615 08:08:45.565050 14075 catalog_manager.cc:5696] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 reported cstate change: term changed from 2 to 3, leader changed from e5f18c39377a41478b22da5e348c4181 (127.4.42.193) to 6ea252efaec54c80a4eaa27683b3f4a1 (127.4.42.195). New cstate: current_term: 3 leader_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:45.658969 14405 raft_consensus.cc:493] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6ea252efaec54c80a4eaa27683b3f4a1)
I20260615 08:08:45.659099 14405 raft_consensus.cc:3060] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 3 FOLLOWER]: Advancing to term 4
I20260615 08:08:45.659160 14438 raft_consensus.cc:493] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6ea252efaec54c80a4eaa27683b3f4a1)
I20260615 08:08:45.659231 14438 raft_consensus.cc:3060] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 3 FOLLOWER]: Advancing to term 4
I20260615 08:08:45.659803 14405 raft_consensus.cc:515] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } }
I20260615 08:08:45.659839 14438 raft_consensus.cc:515] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } }
I20260615 08:08:45.659934 14255 raft_consensus.cc:1240] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 4 FOLLOWER]: Rejecting Update request from peer 6ea252efaec54c80a4eaa27683b3f4a1 for earlier term 3. Current term is 4. Ops: []
I20260615 08:08:45.659978 14405 leader_election.cc:290] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [CANDIDATE]: Term 4 election: Requested vote from peers 6ea252efaec54c80a4eaa27683b3f4a1 (127.4.42.195:39511), e5f18c39377a41478b22da5e348c4181 (127.4.42.193:39447)
I20260615 08:08:45.659993 14438 leader_election.cc:290] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [CANDIDATE]: Term 4 election: Requested vote from peers 6ea252efaec54c80a4eaa27683b3f4a1 (127.4.42.195:39511), c65a2ff8f6a2488cbca18298161bf04b (127.4.42.194:42381)
I20260615 08:08:45.660131 14179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bb810d7b6f47c282840d08acc6c470" candidate_uuid: "c65a2ff8f6a2488cbca18298161bf04b" candidate_term: 4 candidate_status { last_received { term: 3 index: 14164 } } ignore_live_leader: false dest_uuid: "e5f18c39377a41478b22da5e348c4181"
I20260615 08:08:45.660187 14329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bb810d7b6f47c282840d08acc6c470" candidate_uuid: "e5f18c39377a41478b22da5e348c4181" candidate_term: 4 candidate_status { last_received { term: 3 index: 14164 } } ignore_live_leader: false dest_uuid: "6ea252efaec54c80a4eaa27683b3f4a1"
I20260615 08:08:45.660229 14179 raft_consensus.cc:2393] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c65a2ff8f6a2488cbca18298161bf04b in current term 4: Already voted for candidate e5f18c39377a41478b22da5e348c4181 in this term.
I20260615 08:08:45.660240 14433 consensus_queue.cc:1059] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 }, Status: INVALID_TERM, Last received: 3.14164, Next index: 14165, Last known committed idx: 14164, Time since last communication: 0.000s
I20260615 08:08:45.660305 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bb810d7b6f47c282840d08acc6c470" candidate_uuid: "c65a2ff8f6a2488cbca18298161bf04b" candidate_term: 4 candidate_status { last_received { term: 3 index: 14164 } } ignore_live_leader: false dest_uuid: "6ea252efaec54c80a4eaa27683b3f4a1"
I20260615 08:08:45.660369 14255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bb810d7b6f47c282840d08acc6c470" candidate_uuid: "e5f18c39377a41478b22da5e348c4181" candidate_term: 4 candidate_status { last_received { term: 3 index: 14164 } } ignore_live_leader: false dest_uuid: "c65a2ff8f6a2488cbca18298161bf04b"
I20260615 08:08:45.660530 14255 raft_consensus.cc:2393] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f18c39377a41478b22da5e348c4181 in current term 4: Already voted for candidate c65a2ff8f6a2488cbca18298161bf04b in this term.
I20260615 08:08:45.660694 14143 leader_election.cc:304] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f18c39377a41478b22da5e348c4181; no voters: 6ea252efaec54c80a4eaa27683b3f4a1, c65a2ff8f6a2488cbca18298161bf04b
I20260615 08:08:45.660712 14220 leader_election.cc:304] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65a2ff8f6a2488cbca18298161bf04b; no voters: 6ea252efaec54c80a4eaa27683b3f4a1, e5f18c39377a41478b22da5e348c4181
I20260615 08:08:45.660804 14438 raft_consensus.cc:2749] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260615 08:08:45.660832 14405 raft_consensus.cc:2749] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260615 08:08:45.661926 14179 raft_consensus.cc:1240] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 4 FOLLOWER]: Rejecting Update request from peer 6ea252efaec54c80a4eaa27683b3f4a1 for earlier term 3. Current term is 4. Ops: []
I20260615 08:08:45.662154 14433 consensus_queue.cc:1059] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 }, Status: INVALID_TERM, Last received: 3.14164, Next index: 14165, Last known committed idx: 14164, Time since last communication: 0.000s
I20260615 08:08:45.667459 14255 raft_consensus.cc:1240] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 4 FOLLOWER]: Rejecting Update request from peer 6ea252efaec54c80a4eaa27683b3f4a1 for earlier term 3. Current term is 4. Ops: [3.14165-3.14165]
I20260615 08:08:45.667459 14179 raft_consensus.cc:1240] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 4 FOLLOWER]: Rejecting Update request from peer 6ea252efaec54c80a4eaa27683b3f4a1 for earlier term 3. Current term is 4. Ops: [3.14165-3.14165]
I20260615 08:08:45.667688 14433 consensus_queue.cc:1059] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 }, Status: INVALID_TERM, Last received: 3.14164, Next index: 14165, Last known committed idx: 14164, Time since last communication: 0.000s
I20260615 08:08:45.667789 14446 consensus_queue.cc:1059] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 }, Status: INVALID_TERM, Last received: 3.14164, Next index: 14165, Last known committed idx: 14164, Time since last communication: 0.000s
I20260615 08:08:45.672837 14448 raft_consensus.cc:3055] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 3 LEADER]: Stepping down as leader of term 3
I20260615 08:08:45.672886 14448 raft_consensus.cc:740] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6ea252efaec54c80a4eaa27683b3f4a1, State: Running, Role: LEADER
I20260615 08:08:45.672976 14448 consensus_queue.cc:260] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14164, Committed index: 14164, Last appended: 3.14165, Last appended by leader: 14165, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } }
I20260615 08:08:45.673059 14448 raft_consensus.cc:3060] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 3 FOLLOWER]: Advancing to term 4
I20260615 08:08:45.699853 14438 raft_consensus.cc:493] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:45.699928 14438 raft_consensus.cc:3060] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 4 FOLLOWER]: Advancing to term 5
I20260615 08:08:45.700508 14438 raft_consensus.cc:515] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } }
I20260615 08:08:45.700685 14438 leader_election.cc:290] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [CANDIDATE]: Term 5 election: Requested vote from peers 6ea252efaec54c80a4eaa27683b3f4a1 (127.4.42.195:39511), c65a2ff8f6a2488cbca18298161bf04b (127.4.42.194:42381)
I20260615 08:08:45.700847 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bb810d7b6f47c282840d08acc6c470" candidate_uuid: "e5f18c39377a41478b22da5e348c4181" candidate_term: 5 candidate_status { last_received { term: 3 index: 14164 } } ignore_live_leader: false dest_uuid: "6ea252efaec54c80a4eaa27683b3f4a1"
I20260615 08:08:45.700930 14255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bb810d7b6f47c282840d08acc6c470" candidate_uuid: "e5f18c39377a41478b22da5e348c4181" candidate_term: 5 candidate_status { last_received { term: 3 index: 14164 } } ignore_live_leader: false dest_uuid: "c65a2ff8f6a2488cbca18298161bf04b"
I20260615 08:08:45.700961 14330 raft_consensus.cc:3060] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 4 FOLLOWER]: Advancing to term 5
I20260615 08:08:45.701066 14255 raft_consensus.cc:3060] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 4 FOLLOWER]: Advancing to term 5
I20260615 08:08:45.701603 14255 raft_consensus.cc:2468] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5f18c39377a41478b22da5e348c4181 in term 5.
I20260615 08:08:45.701668 14330 raft_consensus.cc:2410] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f18c39377a41478b22da5e348c4181 for term 5 because replica has last-logged OpId of term: 3 index: 14165, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 14164.
I20260615 08:08:45.701839 14143 leader_election.cc:304] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c65a2ff8f6a2488cbca18298161bf04b, e5f18c39377a41478b22da5e348c4181; no voters:
I20260615 08:08:45.701949 14438 raft_consensus.cc:2804] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 5 FOLLOWER]: Leader election won for term 5
I20260615 08:08:45.702025 14438 raft_consensus.cc:697] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 5 LEADER]: Becoming Leader. State: Replica: e5f18c39377a41478b22da5e348c4181, State: Running, Role: LEADER
I20260615 08:08:45.702068 14438 consensus_queue.cc:237] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14164, Committed index: 14164, Last appended: 3.14164, Last appended by leader: 14164, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } }
I20260615 08:08:45.702569 14067 catalog_manager.cc:5696] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 reported cstate change: term changed from 3 to 5, leader changed from 6ea252efaec54c80a4eaa27683b3f4a1 (127.4.42.195) to e5f18c39377a41478b22da5e348c4181 (127.4.42.193). New cstate: current_term: 5 leader_uuid: "e5f18c39377a41478b22da5e348c4181" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } health_report { overall_health: HEALTHY } } }
I20260615 08:08:45.705299 14433 raft_consensus.cc:493] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:45.705379 14433 raft_consensus.cc:3060] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 5 FOLLOWER]: Advancing to term 6
I20260615 08:08:45.705896 14433 raft_consensus.cc:515] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } }
I20260615 08:08:45.706041 14433 leader_election.cc:290] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [CANDIDATE]: Term 6 election: Requested vote from peers c65a2ff8f6a2488cbca18298161bf04b (127.4.42.194:42381), e5f18c39377a41478b22da5e348c4181 (127.4.42.193:39447)
I20260615 08:08:45.706159 14255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bb810d7b6f47c282840d08acc6c470" candidate_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" candidate_term: 6 candidate_status { last_received { term: 3 index: 14165 } } ignore_live_leader: false dest_uuid: "c65a2ff8f6a2488cbca18298161bf04b"
I20260615 08:08:45.706190 14179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bb810d7b6f47c282840d08acc6c470" candidate_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" candidate_term: 6 candidate_status { last_received { term: 3 index: 14165 } } ignore_live_leader: false dest_uuid: "e5f18c39377a41478b22da5e348c4181"
I20260615 08:08:45.706233 14255 raft_consensus.cc:3060] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 5 FOLLOWER]: Advancing to term 6
I20260615 08:08:45.706758 14255 raft_consensus.cc:2468] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ea252efaec54c80a4eaa27683b3f4a1 in term 6.
I20260615 08:08:45.706933 14294 leader_election.cc:304] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ea252efaec54c80a4eaa27683b3f4a1, c65a2ff8f6a2488cbca18298161bf04b; no voters: e5f18c39377a41478b22da5e348c4181
I20260615 08:08:45.707051 14433 raft_consensus.cc:2804] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 6 FOLLOWER]: Leader election won for term 6
I20260615 08:08:45.707111 14433 raft_consensus.cc:697] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 6 LEADER]: Becoming Leader. State: Replica: 6ea252efaec54c80a4eaa27683b3f4a1, State: Running, Role: LEADER
I20260615 08:08:45.707160 14433 consensus_queue.cc:237] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14164, Committed index: 14164, Last appended: 3.14165, Last appended by leader: 14165, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } }
I20260615 08:08:45.724622 14330 raft_consensus.cc:1240] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 6 LEADER]: Rejecting Update request from peer e5f18c39377a41478b22da5e348c4181 for earlier term 5. Current term is 6. Ops: []
I20260615 08:08:45.724833 14438 consensus_queue.cc:1059] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14165, Last known committed idx: 14164, Time since last communication: 0.000s
I20260615 08:08:45.724924 14438 consensus_queue.cc:1243] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [LEADER]: Peer 6ea252efaec54c80a4eaa27683b3f4a1 log is divergent from this leader: its last log entry 6.14166 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14164
I20260615 08:08:45.734799 14255 raft_consensus.cc:1240] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 6 FOLLOWER]: Rejecting Update request from peer e5f18c39377a41478b22da5e348c4181 for earlier term 5. Current term is 6. Ops: []
I20260615 08:08:45.735071 14438 consensus_queue.cc:1059] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14165, Last known committed idx: 14164, Time since last communication: 0.000s
I20260615 08:08:45.735980 14179 raft_consensus.cc:3055] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 5 LEADER]: Stepping down as leader of term 5
I20260615 08:08:45.736037 14179 raft_consensus.cc:740] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e5f18c39377a41478b22da5e348c4181, State: Running, Role: LEADER
I20260615 08:08:45.736104 14179 consensus_queue.cc:260] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14164, Committed index: 14164, Last appended: 5.14165, Last appended by leader: 14165, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } }
I20260615 08:08:45.736188 14179 raft_consensus.cc:3060] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 5 FOLLOWER]: Advancing to term 6
I20260615 08:08:45.736758 14179 raft_consensus.cc:1275] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 6 FOLLOWER]: Refusing update from remote peer 6ea252efaec54c80a4eaa27683b3f4a1: Log matching property violated. Preceding OpId in replica: term: 5 index: 14165. Preceding OpId from leader: term: 6 index: 14166. (index mismatch)
I20260615 08:08:45.737030 14433 consensus_queue.cc:1048] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14166, Last known committed idx: 14164, Time since last communication: 0.000s
I20260615 08:08:45.737125 14433 consensus_queue.cc:1243] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [LEADER]: Peer e5f18c39377a41478b22da5e348c4181 log is divergent from this leader: its last log entry 5.14165 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14164
I20260615 08:08:45.737393 14179 pending_rounds.cc:85] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181: Aborting all ops after (but not including) 14164
I20260615 08:08:45.737432 14179 pending_rounds.cc:107] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181: Aborting uncommitted NO_OP operation due to leader change: 5.14165
I20260615 08:08:45.737445 14179 raft_consensus.cc:2889] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260615 08:08:45.740952 14255 raft_consensus.cc:1275] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 6 FOLLOWER]: Refusing update from remote peer 6ea252efaec54c80a4eaa27683b3f4a1: Log matching property violated. Preceding OpId in replica: term: 3 index: 14164. Preceding OpId from leader: term: 6 index: 14166. (index mismatch)
I20260615 08:08:45.741180 14433 consensus_queue.cc:1048] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14166, Last known committed idx: 14164, Time since last communication: 0.000s
I20260615 08:08:45.746373 14076 catalog_manager.cc:5696] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 reported cstate change: term changed from 5 to 6, leader changed from e5f18c39377a41478b22da5e348c4181 (127.4.42.193) to 6ea252efaec54c80a4eaa27683b3f4a1 (127.4.42.195). New cstate: current_term: 6 leader_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } health_report { overall_health: UNKNOWN } } }
W20260615 08:08:45.769151 14448 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 6 is higher.
W20260615 08:08:45.769290 14448 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 6 is higher.
I20260615 08:08:45.771608 14405 raft_consensus.cc:493] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6ea252efaec54c80a4eaa27683b3f4a1)
I20260615 08:08:45.771668 14405 raft_consensus.cc:3060] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 6 FOLLOWER]: Advancing to term 7
I20260615 08:08:45.772280 14405 raft_consensus.cc:515] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } }
I20260615 08:08:45.772414 14405 leader_election.cc:290] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [CANDIDATE]: Term 7 election: Requested vote from peers 6ea252efaec54c80a4eaa27683b3f4a1 (127.4.42.195:39511), e5f18c39377a41478b22da5e348c4181 (127.4.42.193:39447)
I20260615 08:08:45.772601 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bb810d7b6f47c282840d08acc6c470" candidate_uuid: "c65a2ff8f6a2488cbca18298161bf04b" candidate_term: 7 candidate_status { last_received { term: 6 index: 14166 } } ignore_live_leader: false dest_uuid: "6ea252efaec54c80a4eaa27683b3f4a1"
I20260615 08:08:45.772601 14179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bb810d7b6f47c282840d08acc6c470" candidate_uuid: "c65a2ff8f6a2488cbca18298161bf04b" candidate_term: 7 candidate_status { last_received { term: 6 index: 14166 } } ignore_live_leader: false dest_uuid: "e5f18c39377a41478b22da5e348c4181"
I20260615 08:08:45.772890 14218 leader_election.cc:304] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c65a2ff8f6a2488cbca18298161bf04b; no voters: 6ea252efaec54c80a4eaa27683b3f4a1, e5f18c39377a41478b22da5e348c4181
I20260615 08:08:45.773002 14405 raft_consensus.cc:2749] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260615 08:08:45.777117 14255 raft_consensus.cc:1240] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 7 FOLLOWER]: Rejecting Update request from peer 6ea252efaec54c80a4eaa27683b3f4a1 for earlier term 6. Current term is 7. Ops: []
I20260615 08:08:45.777315 14446 consensus_queue.cc:1059] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 }, Status: INVALID_TERM, Last received: 6.14166, Next index: 14167, Last known committed idx: 14166, Time since last communication: 0.000s
I20260615 08:08:45.797674 14442 raft_consensus.cc:493] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6ea252efaec54c80a4eaa27683b3f4a1)
I20260615 08:08:45.797742 14442 raft_consensus.cc:3060] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 6 FOLLOWER]: Advancing to term 7
I20260615 08:08:45.798339 14442 raft_consensus.cc:515] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } }
I20260615 08:08:45.798513 14179 raft_consensus.cc:1240] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 7 FOLLOWER]: Rejecting Update request from peer 6ea252efaec54c80a4eaa27683b3f4a1 for earlier term 6. Current term is 7. Ops: []
I20260615 08:08:45.798589 14442 leader_election.cc:290] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [CANDIDATE]: Term 7 election: Requested vote from peers 6ea252efaec54c80a4eaa27683b3f4a1 (127.4.42.195:39511), c65a2ff8f6a2488cbca18298161bf04b (127.4.42.194:42381)
I20260615 08:08:45.798727 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bb810d7b6f47c282840d08acc6c470" candidate_uuid: "e5f18c39377a41478b22da5e348c4181" candidate_term: 7 candidate_status { last_received { term: 6 index: 14166 } } ignore_live_leader: false dest_uuid: "6ea252efaec54c80a4eaa27683b3f4a1"
I20260615 08:08:45.798739 14433 consensus_queue.cc:1059] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 }, Status: INVALID_TERM, Last received: 6.14166, Next index: 14167, Last known committed idx: 14166, Time since last communication: 0.000s
I20260615 08:08:45.798763 14255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bb810d7b6f47c282840d08acc6c470" candidate_uuid: "e5f18c39377a41478b22da5e348c4181" candidate_term: 7 candidate_status { last_received { term: 6 index: 14166 } } ignore_live_leader: false dest_uuid: "c65a2ff8f6a2488cbca18298161bf04b"
I20260615 08:08:45.798858 14255 raft_consensus.cc:2393] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f18c39377a41478b22da5e348c4181 in current term 7: Already voted for candidate c65a2ff8f6a2488cbca18298161bf04b in this term.
I20260615 08:08:45.799018 14143 leader_election.cc:304] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f18c39377a41478b22da5e348c4181; no voters: 6ea252efaec54c80a4eaa27683b3f4a1, c65a2ff8f6a2488cbca18298161bf04b
I20260615 08:08:45.799118 14442 raft_consensus.cc:2749] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260615 08:08:45.800231 14255 raft_consensus.cc:1240] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 7 FOLLOWER]: Rejecting Update request from peer 6ea252efaec54c80a4eaa27683b3f4a1 for earlier term 6. Current term is 7. Ops: [6.14167-6.14167]
I20260615 08:08:45.800238 14179 raft_consensus.cc:1240] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 7 FOLLOWER]: Rejecting Update request from peer 6ea252efaec54c80a4eaa27683b3f4a1 for earlier term 6. Current term is 7. Ops: [6.14167-6.14167]
I20260615 08:08:45.800443 14446 consensus_queue.cc:1059] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 }, Status: INVALID_TERM, Last received: 6.14166, Next index: 14167, Last known committed idx: 14166, Time since last communication: 0.000s
I20260615 08:08:45.800563 14433 consensus_queue.cc:1059] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 }, Status: INVALID_TERM, Last received: 6.14166, Next index: 14167, Last known committed idx: 14166, Time since last communication: 0.000s
I20260615 08:08:45.809526 14405 raft_consensus.cc:493] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:45.809595 14405 raft_consensus.cc:3060] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 7 FOLLOWER]: Advancing to term 8
I20260615 08:08:45.810130 14405 raft_consensus.cc:515] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } }
I20260615 08:08:45.810284 14405 leader_election.cc:290] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [CANDIDATE]: Term 8 election: Requested vote from peers 6ea252efaec54c80a4eaa27683b3f4a1 (127.4.42.195:39511), e5f18c39377a41478b22da5e348c4181 (127.4.42.193:39447)
I20260615 08:08:45.810386 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bb810d7b6f47c282840d08acc6c470" candidate_uuid: "c65a2ff8f6a2488cbca18298161bf04b" candidate_term: 8 candidate_status { last_received { term: 6 index: 14166 } } ignore_live_leader: false dest_uuid: "6ea252efaec54c80a4eaa27683b3f4a1"
I20260615 08:08:45.810396 14179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bb810d7b6f47c282840d08acc6c470" candidate_uuid: "c65a2ff8f6a2488cbca18298161bf04b" candidate_term: 8 candidate_status { last_received { term: 6 index: 14166 } } ignore_live_leader: false dest_uuid: "e5f18c39377a41478b22da5e348c4181"
I20260615 08:08:45.810479 14179 raft_consensus.cc:3060] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 7 FOLLOWER]: Advancing to term 8
I20260615 08:08:45.811031 14179 raft_consensus.cc:2468] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65a2ff8f6a2488cbca18298161bf04b in term 8.
I20260615 08:08:45.811239 14218 leader_election.cc:304] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c65a2ff8f6a2488cbca18298161bf04b, e5f18c39377a41478b22da5e348c4181; no voters: 6ea252efaec54c80a4eaa27683b3f4a1
I20260615 08:08:45.811333 14405 raft_consensus.cc:2804] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 8 FOLLOWER]: Leader election won for term 8
I20260615 08:08:45.811404 14405 raft_consensus.cc:697] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 8 LEADER]: Becoming Leader. State: Replica: c65a2ff8f6a2488cbca18298161bf04b, State: Running, Role: LEADER
I20260615 08:08:45.811461 14405 consensus_queue.cc:237] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14166, Committed index: 14166, Last appended: 6.14166, Last appended by leader: 14166, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } }
I20260615 08:08:45.811908 14075 catalog_manager.cc:5696] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b reported cstate change: term changed from 6 to 8, leader changed from 6ea252efaec54c80a4eaa27683b3f4a1 (127.4.42.195) to c65a2ff8f6a2488cbca18298161bf04b (127.4.42.194). New cstate: current_term: 8 leader_uuid: "c65a2ff8f6a2488cbca18298161bf04b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:45.825671 14255 raft_consensus.cc:1240] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 8 LEADER]: Rejecting Update request from peer 6ea252efaec54c80a4eaa27683b3f4a1 for earlier term 6. Current term is 8. Ops: [6.14167-6.14167]
I20260615 08:08:45.825917 14433 consensus_queue.cc:1059] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 }, Status: INVALID_TERM, Last received: 6.14166, Next index: 14167, Last known committed idx: 14166, Time since last communication: 0.000s
I20260615 08:08:45.826021 14433 consensus_queue.cc:1243] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [LEADER]: Peer c65a2ff8f6a2488cbca18298161bf04b log is divergent from this leader: its last log entry 8.14167 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14166
I20260615 08:08:45.828209 14179 raft_consensus.cc:1240] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 8 FOLLOWER]: Rejecting Update request from peer 6ea252efaec54c80a4eaa27683b3f4a1 for earlier term 6. Current term is 8. Ops: [6.14167-6.14167]
I20260615 08:08:45.828416 14433 consensus_queue.cc:1059] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 }, Status: INVALID_TERM, Last received: 6.14166, Next index: 14167, Last known committed idx: 14166, Time since last communication: 0.000s
I20260615 08:08:45.833822 14448 raft_consensus.cc:3055] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 6 LEADER]: Stepping down as leader of term 6
I20260615 08:08:45.833890 14448 raft_consensus.cc:740] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6ea252efaec54c80a4eaa27683b3f4a1, State: Running, Role: LEADER
I20260615 08:08:45.833982 14448 consensus_queue.cc:260] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14166, Committed index: 14166, Last appended: 6.14167, Last appended by leader: 14167, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } }
I20260615 08:08:45.834072 14448 raft_consensus.cc:3060] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 6 FOLLOWER]: Advancing to term 7
I20260615 08:08:45.842243 14330 raft_consensus.cc:3060] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 7 FOLLOWER]: Advancing to term 8
I20260615 08:08:45.842797 14330 raft_consensus.cc:1275] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 8 FOLLOWER]: Refusing update from remote peer c65a2ff8f6a2488cbca18298161bf04b: Log matching property violated. Preceding OpId in replica: term: 6 index: 14167. Preceding OpId from leader: term: 8 index: 14167. (term mismatch)
I20260615 08:08:45.842833 14330 pending_rounds.cc:85] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1: Aborting all ops after (but not including) 14166
I20260615 08:08:45.842845 14330 pending_rounds.cc:107] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1: Aborting uncommitted PARTICIPANT_OP operation due to leader change: 6.14167
W20260615 08:08:45.842869 14330 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:57348: Aborted: Op aborted by new leader
I20260615 08:08:45.843117 14405 consensus_queue.cc:1048] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14167, Last known committed idx: 14166, Time since last communication: 0.000s
I20260615 08:08:45.844065 14179 raft_consensus.cc:1275] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 8 FOLLOWER]: Refusing update from remote peer c65a2ff8f6a2488cbca18298161bf04b: Log matching property violated. Preceding OpId in replica: term: 6 index: 14166. Preceding OpId from leader: term: 8 index: 14167. (index mismatch)
I20260615 08:08:45.844237 14405 consensus_queue.cc:1048] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14167, Last known committed idx: 14166, Time since last communication: 0.000s
I20260615 08:08:45.904543 14433 raft_consensus.cc:493] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c65a2ff8f6a2488cbca18298161bf04b)
I20260615 08:08:45.904623 14433 raft_consensus.cc:3060] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 8 FOLLOWER]: Advancing to term 9
I20260615 08:08:45.905246 14433 raft_consensus.cc:515] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } }
I20260615 08:08:45.905411 14433 leader_election.cc:290] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [CANDIDATE]: Term 9 election: Requested vote from peers c65a2ff8f6a2488cbca18298161bf04b (127.4.42.194:42381), e5f18c39377a41478b22da5e348c4181 (127.4.42.193:39447)
I20260615 08:08:45.905545 14255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bb810d7b6f47c282840d08acc6c470" candidate_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" candidate_term: 9 candidate_status { last_received { term: 8 index: 14168 } } ignore_live_leader: false dest_uuid: "c65a2ff8f6a2488cbca18298161bf04b"
I20260615 08:08:45.905583 14179 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bb810d7b6f47c282840d08acc6c470" candidate_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" candidate_term: 9 candidate_status { last_received { term: 8 index: 14168 } } ignore_live_leader: false dest_uuid: "e5f18c39377a41478b22da5e348c4181"
I20260615 08:08:45.905862 14293 leader_election.cc:304] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ea252efaec54c80a4eaa27683b3f4a1; no voters: c65a2ff8f6a2488cbca18298161bf04b, e5f18c39377a41478b22da5e348c4181
I20260615 08:08:45.905970 14433 raft_consensus.cc:2749] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260615 08:08:45.908730 14330 raft_consensus.cc:1240] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 9 FOLLOWER]: Rejecting Update request from peer c65a2ff8f6a2488cbca18298161bf04b for earlier term 8. Current term is 9. Ops: []
I20260615 08:08:45.908987 14424 consensus_queue.cc:1059] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 }, Status: INVALID_TERM, Last received: 8.14168, Next index: 14169, Last known committed idx: 14168, Time since last communication: 0.000s
I20260615 08:08:45.926132 14442 raft_consensus.cc:493] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c65a2ff8f6a2488cbca18298161bf04b)
I20260615 08:08:45.926190 14442 raft_consensus.cc:3060] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 8 FOLLOWER]: Advancing to term 9
I20260615 08:08:45.926909 14442 raft_consensus.cc:515] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } }
I20260615 08:08:45.927066 14442 leader_election.cc:290] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [CANDIDATE]: Term 9 election: Requested vote from peers 6ea252efaec54c80a4eaa27683b3f4a1 (127.4.42.195:39511), c65a2ff8f6a2488cbca18298161bf04b (127.4.42.194:42381)
I20260615 08:08:45.927263 14255 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bb810d7b6f47c282840d08acc6c470" candidate_uuid: "e5f18c39377a41478b22da5e348c4181" candidate_term: 9 candidate_status { last_received { term: 8 index: 14168 } } ignore_live_leader: false dest_uuid: "c65a2ff8f6a2488cbca18298161bf04b"
I20260615 08:08:45.927273 14330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78bb810d7b6f47c282840d08acc6c470" candidate_uuid: "e5f18c39377a41478b22da5e348c4181" candidate_term: 9 candidate_status { last_received { term: 8 index: 14168 } } ignore_live_leader: false dest_uuid: "6ea252efaec54c80a4eaa27683b3f4a1"
I20260615 08:08:45.927376 14330 raft_consensus.cc:2393] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e5f18c39377a41478b22da5e348c4181 in current term 9: Already voted for candidate 6ea252efaec54c80a4eaa27683b3f4a1 in this term.
I20260615 08:08:45.927552 14144 leader_election.cc:304] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5f18c39377a41478b22da5e348c4181; no voters: 6ea252efaec54c80a4eaa27683b3f4a1, c65a2ff8f6a2488cbca18298161bf04b
I20260615 08:08:45.927649 14442 raft_consensus.cc:2749] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260615 08:08:45.929095 4267 tablet_server.cc:179] TabletServer@127.4.42.193:0 shutting down...
W20260615 08:08:45.931034 14218 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 18 similar messages]
W20260615 08:08:45.931618 14218 consensus_peers.cc:597] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b -> Peer e5f18c39377a41478b22da5e348c4181 (127.4.42.193:39447): Couldn't send request to peer e5f18c39377a41478b22da5e348c4181. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260615 08:08:45.932678 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:08:45.932792 4267 tablet_replica.cc:333] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181: stopping tablet replica
I20260615 08:08:45.932855 4267 raft_consensus.cc:2243] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260615 08:08:45.932898 4267 raft_consensus.cc:2272] T 78bb810d7b6f47c282840d08acc6c470 P e5f18c39377a41478b22da5e348c4181 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260615 08:08:45.937752 4267 tablet_server.cc:196] TabletServer@127.4.42.193:0 shutdown complete.
I20260615 08:08:45.938627 14433 raft_consensus.cc:493] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:45.938687 4267 tablet_server.cc:179] TabletServer@127.4.42.194:0 shutting down...
I20260615 08:08:45.938709 14433 raft_consensus.cc:3060] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 9 FOLLOWER]: Advancing to term 10
I20260615 08:08:45.939489 14433 raft_consensus.cc:515] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 } } peers { permanent_uuid: "c65a2ff8f6a2488cbca18298161bf04b" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 42381 } } peers { permanent_uuid: "e5f18c39377a41478b22da5e348c4181" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 39447 } }
I20260615 08:08:45.939783 14433 leader_election.cc:290] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [CANDIDATE]: Term 10 election: Requested vote from peers c65a2ff8f6a2488cbca18298161bf04b (127.4.42.194:42381), e5f18c39377a41478b22da5e348c4181 (127.4.42.193:39447)
W20260615 08:08:45.940306 14294 leader_election.cc:336] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c65a2ff8f6a2488cbca18298161bf04b (127.4.42.194:42381): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260615 08:08:45.941501 14293 leader_election.cc:336] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer e5f18c39377a41478b22da5e348c4181 (127.4.42.193:39447): Network error: Client connection negotiation failed: client connection to 127.4.42.193:39447: connect: Connection refused (error 111)
I20260615 08:08:45.941609 14293 leader_election.cc:304] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6ea252efaec54c80a4eaa27683b3f4a1; no voters: c65a2ff8f6a2488cbca18298161bf04b, e5f18c39377a41478b22da5e348c4181
I20260615 08:08:45.941676 14433 raft_consensus.cc:2749] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260615 08:08:45.943945 14330 raft_consensus.cc:1240] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 10 FOLLOWER]: Rejecting Update request from peer c65a2ff8f6a2488cbca18298161bf04b for earlier term 8. Current term is 10. Ops: []
I20260615 08:08:45.944160 14424 consensus_queue.cc:1059] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6ea252efaec54c80a4eaa27683b3f4a1" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 39511 }, Status: INVALID_TERM, Last received: 8.14168, Next index: 14169, Last known committed idx: 14168, Time since last communication: 0.000s
I20260615 08:08:45.945281 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:08:45.945365 4267 tablet_replica.cc:333] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b: stopping tablet replica
I20260615 08:08:45.945412 4267 raft_consensus.cc:2243] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 8 LEADER]: Raft consensus shutting down.
W20260615 08:08:45.953755 14418 raft_consensus.cc:932] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 8 LEADER]: Unable to handle notification of new term (9): Illegal state: RaftConsensus is not running: State = Stopping
I20260615 08:08:45.953881 4267 raft_consensus.cc:2272] T 78bb810d7b6f47c282840d08acc6c470 P c65a2ff8f6a2488cbca18298161bf04b [term 8 FOLLOWER]: Raft consensus is shut down!
I20260615 08:08:45.977372 4267 tablet_server.cc:196] TabletServer@127.4.42.194:0 shutdown complete.
I20260615 08:08:45.978287 4267 tablet_server.cc:179] TabletServer@127.4.42.195:0 shutting down...
I20260615 08:08:45.981734 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:08:45.981864 4267 tablet_replica.cc:333] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1: stopping tablet replica
I20260615 08:08:45.981923 4267 raft_consensus.cc:2243] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260615 08:08:45.983836 4267 raft_consensus.cc:2272] T 78bb810d7b6f47c282840d08acc6c470 P 6ea252efaec54c80a4eaa27683b3f4a1 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260615 08:08:45.998780 4267 tablet_server.cc:196] TabletServer@127.4.42.195:0 shutdown complete.
I20260615 08:08:45.999670 4267 master.cc:562] Master@127.4.42.254:42685 shutting down...
I20260615 08:08:46.002610 4267 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7de681fa62de4d4581753289ce8dfd38 [term 1 LEADER]: Raft consensus shutting down.
I20260615 08:08:46.002667 4267 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7de681fa62de4d4581753289ce8dfd38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:08:46.002686 4267 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7de681fa62de4d4581753289ce8dfd38: stopping tablet replica
I20260615 08:08:46.014302 4267 master.cc:584] Master@127.4.42.254:42685 shutdown complete.
[ OK ] TxnParticipantElectionStormITest.TestTxnSystemClientRetriesThroughStorm (10788 ms)
[----------] 2 tests from TxnParticipantElectionStormITest (36639 ms total)
[----------] 2 tests from ShouldGCWals/ParticipantCopyITest
[ RUN ] ShouldGCWals/ParticipantCopyITest.TestCopyParticipantOps/0
I20260615 08:08:46.033461 4267 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.42.254:41635
I20260615 08:08:46.033592 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:08:46.035002 14455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:08:46.035048 14452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:08:46.035221 14453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:08:46.035233 4267 server_base.cc:1061] running on GCE node
I20260615 08:08:46.035359 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:08:46.035413 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:08:46.035452 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510926035442 us; error 0 us; skew 500 ppm
I20260615 08:08:46.035966 4267 webserver.cc:533] Webserver started at http://127.4.42.254:38343/ using document root <none> and password file <none>
I20260615 08:08:46.036060 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:08:46.036124 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:08:46.036173 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:08:46.036422 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/master-0-root/instance:
uuid: "8441fd568a084c40a32d3b05578699b1"
format_stamp: "Formatted at 2026-06-15 08:08:46 on dist-test-slave-37n8"
I20260615 08:08:46.037261 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:08:46.037683 14460 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:46.037875 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:46.037931 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/master-0-root
uuid: "8441fd568a084c40a32d3b05578699b1"
format_stamp: "Formatted at 2026-06-15 08:08:46 on dist-test-slave-37n8"
I20260615 08:08:46.037977 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:08:46.047215 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:08:46.047384 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:08:46.049893 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.254:41635
I20260615 08:08:46.062346 14512 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.254:41635 every 8 connection(s)
I20260615 08:08:46.062631 14513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:08:46.063591 14513 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8441fd568a084c40a32d3b05578699b1: Bootstrap starting.
I20260615 08:08:46.063897 14513 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8441fd568a084c40a32d3b05578699b1: Neither blocks nor log segments found. Creating new log.
I20260615 08:08:46.064350 14513 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8441fd568a084c40a32d3b05578699b1: No bootstrap required, opened a new log
I20260615 08:08:46.064493 14513 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8441fd568a084c40a32d3b05578699b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8441fd568a084c40a32d3b05578699b1" member_type: VOTER }
I20260615 08:08:46.064558 14513 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8441fd568a084c40a32d3b05578699b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:08:46.064590 14513 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8441fd568a084c40a32d3b05578699b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8441fd568a084c40a32d3b05578699b1, State: Initialized, Role: FOLLOWER
I20260615 08:08:46.064666 14513 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8441fd568a084c40a32d3b05578699b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8441fd568a084c40a32d3b05578699b1" member_type: VOTER }
I20260615 08:08:46.064728 14513 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8441fd568a084c40a32d3b05578699b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260615 08:08:46.064759 14513 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8441fd568a084c40a32d3b05578699b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260615 08:08:46.064790 14513 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8441fd568a084c40a32d3b05578699b1 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:08:46.065258 14513 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8441fd568a084c40a32d3b05578699b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8441fd568a084c40a32d3b05578699b1" member_type: VOTER }
I20260615 08:08:46.065341 14513 leader_election.cc:304] T 00000000000000000000000000000000 P 8441fd568a084c40a32d3b05578699b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8441fd568a084c40a32d3b05578699b1; no voters:
I20260615 08:08:46.065454 14513 leader_election.cc:290] T 00000000000000000000000000000000 P 8441fd568a084c40a32d3b05578699b1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260615 08:08:46.065505 14516 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8441fd568a084c40a32d3b05578699b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:08:46.065605 14513 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8441fd568a084c40a32d3b05578699b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260615 08:08:46.065644 14516 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8441fd568a084c40a32d3b05578699b1 [term 1 LEADER]: Becoming Leader. State: Replica: 8441fd568a084c40a32d3b05578699b1, State: Running, Role: LEADER
I20260615 08:08:46.065723 14516 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8441fd568a084c40a32d3b05578699b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8441fd568a084c40a32d3b05578699b1" member_type: VOTER }
I20260615 08:08:46.065934 14517 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8441fd568a084c40a32d3b05578699b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8441fd568a084c40a32d3b05578699b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8441fd568a084c40a32d3b05578699b1" member_type: VOTER } }
I20260615 08:08:46.065950 14518 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8441fd568a084c40a32d3b05578699b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8441fd568a084c40a32d3b05578699b1. Latest consensus state: current_term: 1 leader_uuid: "8441fd568a084c40a32d3b05578699b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8441fd568a084c40a32d3b05578699b1" member_type: VOTER } }
I20260615 08:08:46.066100 14518 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8441fd568a084c40a32d3b05578699b1 [sys.catalog]: This master's current role is: LEADER
I20260615 08:08:46.066083 14517 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8441fd568a084c40a32d3b05578699b1 [sys.catalog]: This master's current role is: LEADER
I20260615 08:08:46.066603 14524 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260615 08:08:46.066772 14524 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260615 08:08:46.067054 4267 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260615 08:08:46.067382 14524 catalog_manager.cc:1382] Generated new cluster ID: 4c2d58aa0bae4de4a827fa131d676e6e
I20260615 08:08:46.067428 14524 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260615 08:08:46.079478 14524 catalog_manager.cc:1405] Generated new certificate authority record
I20260615 08:08:46.079900 14524 catalog_manager.cc:1539] Loading token signing keys...
I20260615 08:08:46.096861 14524 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 8441fd568a084c40a32d3b05578699b1: Generated new TSK 0
I20260615 08:08:46.096987 14524 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260615 08:08:46.098766 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:08:46.099937 14535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:08:46.100030 14537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:08:46.100028 14534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:08:46.100044 4267 server_base.cc:1061] running on GCE node
I20260615 08:08:46.100251 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:08:46.100286 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:08:46.100307 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510926100306 us; error 0 us; skew 500 ppm
I20260615 08:08:46.100854 4267 webserver.cc:533] Webserver started at http://127.4.42.193:45087/ using document root <none> and password file <none>
I20260615 08:08:46.100948 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:08:46.100994 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:08:46.101042 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:08:46.101293 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-0-root/instance:
uuid: "d2ef54160cb2471ea1d740709d6446b7"
format_stamp: "Formatted at 2026-06-15 08:08:46 on dist-test-slave-37n8"
I20260615 08:08:46.102156 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:08:46.102653 14542 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:46.102784 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:46.102838 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-0-root
uuid: "d2ef54160cb2471ea1d740709d6446b7"
format_stamp: "Formatted at 2026-06-15 08:08:46 on dist-test-slave-37n8"
I20260615 08:08:46.102882 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:08:46.128278 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:08:46.128479 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:08:46.128646 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:08:46.128834 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:08:46.128861 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:46.128880 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:08:46.128919 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:46.131722 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.193:38913
I20260615 08:08:46.132378 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260615 08:08:46.132522 14605 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.193:38913 every 8 connection(s)
W20260615 08:08:46.133421 14608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:08:46.133493 14609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:08:46.133435 14611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:08:46.133764 4267 server_base.cc:1061] running on GCE node
I20260615 08:08:46.133878 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:08:46.133908 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:08:46.133929 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510926133929 us; error 0 us; skew 500 ppm
I20260615 08:08:46.134619 4267 webserver.cc:533] Webserver started at http://127.4.42.194:33297/ using document root <none> and password file <none>
I20260615 08:08:46.134719 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:08:46.134763 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:08:46.134809 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:08:46.135054 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-1-root/instance:
uuid: "a3526be60373413cbbfba3ff5de65968"
format_stamp: "Formatted at 2026-06-15 08:08:46 on dist-test-slave-37n8"
I20260615 08:08:46.136077 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:08:46.136646 14618 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:46.136698 14606 heartbeater.cc:344] Connected to a master server at 127.4.42.254:41635
I20260615 08:08:46.136761 14606 heartbeater.cc:461] Registering TS with master...
I20260615 08:08:46.136799 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260615 08:08:46.136842 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-1-root
uuid: "a3526be60373413cbbfba3ff5de65968"
format_stamp: "Formatted at 2026-06-15 08:08:46 on dist-test-slave-37n8"
I20260615 08:08:46.136874 14606 heartbeater.cc:507] Master 127.4.42.254:41635 requested a full tablet report, sending...
I20260615 08:08:46.136883 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:08:46.138707 14477 ts_manager.cc:194] Registered new tserver with Master: d2ef54160cb2471ea1d740709d6446b7 (127.4.42.193:38913)
I20260615 08:08:46.139263 14477 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44244
I20260615 08:08:46.143551 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:08:46.143729 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:08:46.143869 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:08:46.144055 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:08:46.144081 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:46.144129 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:08:46.144156 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:46.147151 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.194:38477
I20260615 08:08:46.147632 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260615 08:08:46.148173 14681 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.194:38477 every 8 connection(s)
W20260615 08:08:46.149113 14685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:08:46.149118 14687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:08:46.149191 14684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:08:46.149417 4267 server_base.cc:1061] running on GCE node
I20260615 08:08:46.149595 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:08:46.149639 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:08:46.149657 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510926149657 us; error 0 us; skew 500 ppm
I20260615 08:08:46.150172 4267 webserver.cc:533] Webserver started at http://127.4.42.195:34861/ using document root <none> and password file <none>
I20260615 08:08:46.150251 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:08:46.150298 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:08:46.150341 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:08:46.150650 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-2-root/instance:
uuid: "ccd348dbed854f12940183b7be1966c4"
format_stamp: "Formatted at 2026-06-15 08:08:46 on dist-test-slave-37n8"
I20260615 08:08:46.151654 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:08:46.151995 14682 heartbeater.cc:344] Connected to a master server at 127.4.42.254:41635
I20260615 08:08:46.152058 14682 heartbeater.cc:461] Registering TS with master...
I20260615 08:08:46.152161 14682 heartbeater.cc:507] Master 127.4.42.254:41635 requested a full tablet report, sending...
I20260615 08:08:46.152220 14693 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:46.152398 14477 ts_manager.cc:194] Registered new tserver with Master: a3526be60373413cbbfba3ff5de65968 (127.4.42.194:38477)
I20260615 08:08:46.152423 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:46.152505 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-2-root
uuid: "ccd348dbed854f12940183b7be1966c4"
format_stamp: "Formatted at 2026-06-15 08:08:46 on dist-test-slave-37n8"
I20260615 08:08:46.152546 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:08:46.152837 14477 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44254
I20260615 08:08:46.168964 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:08:46.169189 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:08:46.169350 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:08:46.169538 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:08:46.169584 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:46.169620 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:08:46.169646 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:08:46.172875 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.195:43783
I20260615 08:08:46.172910 14756 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.195:43783 every 8 connection(s)
I20260615 08:08:46.175904 14757 heartbeater.cc:344] Connected to a master server at 127.4.42.254:41635
I20260615 08:08:46.175963 14757 heartbeater.cc:461] Registering TS with master...
I20260615 08:08:46.176033 14757 heartbeater.cc:507] Master 127.4.42.254:41635 requested a full tablet report, sending...
I20260615 08:08:46.176270 14477 ts_manager.cc:194] Registered new tserver with Master: ccd348dbed854f12940183b7be1966c4 (127.4.42.195:43783)
I20260615 08:08:46.176455 4267 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003347455s
I20260615 08:08:46.176726 14477 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44266
I20260615 08:08:46.181156 14477 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44278:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260615 08:08:46.181310 14477 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260615 08:08:46.186069 14570 tablet_service.cc:1511] Processing CreateTablet for tablet 2aee5f7f624a45c0be14bc719f978693 (DEFAULT_TABLE table=test-workload [id=292eebff7d1e4a47bf95a6c7b795713f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:08:46.186210 14570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aee5f7f624a45c0be14bc719f978693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:08:46.186530 14646 tablet_service.cc:1511] Processing CreateTablet for tablet 2aee5f7f624a45c0be14bc719f978693 (DEFAULT_TABLE table=test-workload [id=292eebff7d1e4a47bf95a6c7b795713f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:08:46.186635 14646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aee5f7f624a45c0be14bc719f978693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:08:46.186650 14721 tablet_service.cc:1511] Processing CreateTablet for tablet 2aee5f7f624a45c0be14bc719f978693 (DEFAULT_TABLE table=test-workload [id=292eebff7d1e4a47bf95a6c7b795713f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:08:46.186757 14721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aee5f7f624a45c0be14bc719f978693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:08:46.187826 14773 tablet_bootstrap.cc:492] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4: Bootstrap starting.
I20260615 08:08:46.187767 14772 tablet_bootstrap.cc:492] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7: Bootstrap starting.
I20260615 08:08:46.188323 14772 tablet_bootstrap.cc:654] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7: Neither blocks nor log segments found. Creating new log.
I20260615 08:08:46.188436 14773 tablet_bootstrap.cc:654] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4: Neither blocks nor log segments found. Creating new log.
I20260615 08:08:46.188714 14774 tablet_bootstrap.cc:492] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968: Bootstrap starting.
I20260615 08:08:46.188932 14772 tablet_bootstrap.cc:492] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7: No bootstrap required, opened a new log
I20260615 08:08:46.188970 14772 ts_tablet_manager.cc:1403] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:08:46.189051 14773 tablet_bootstrap.cc:492] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4: No bootstrap required, opened a new log
I20260615 08:08:46.189102 14773 ts_tablet_manager.cc:1403] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:08:46.189141 14772 raft_consensus.cc:359] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3526be60373413cbbfba3ff5de65968" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38477 } } peers { permanent_uuid: "ccd348dbed854f12940183b7be1966c4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43783 } } peers { permanent_uuid: "d2ef54160cb2471ea1d740709d6446b7" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 38913 } }
I20260615 08:08:46.189205 14772 raft_consensus.cc:385] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:08:46.189232 14772 raft_consensus.cc:740] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2ef54160cb2471ea1d740709d6446b7, State: Initialized, Role: FOLLOWER
I20260615 08:08:46.189250 14773 raft_consensus.cc:359] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3526be60373413cbbfba3ff5de65968" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38477 } } peers { permanent_uuid: "ccd348dbed854f12940183b7be1966c4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43783 } } peers { permanent_uuid: "d2ef54160cb2471ea1d740709d6446b7" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 38913 } }
I20260615 08:08:46.189282 14772 consensus_queue.cc:260] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3526be60373413cbbfba3ff5de65968" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38477 } } peers { permanent_uuid: "ccd348dbed854f12940183b7be1966c4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43783 } } peers { permanent_uuid: "d2ef54160cb2471ea1d740709d6446b7" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 38913 } }
I20260615 08:08:46.189321 14773 raft_consensus.cc:385] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:08:46.189345 14773 raft_consensus.cc:740] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccd348dbed854f12940183b7be1966c4, State: Initialized, Role: FOLLOWER
I20260615 08:08:46.189393 14773 consensus_queue.cc:260] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3526be60373413cbbfba3ff5de65968" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38477 } } peers { permanent_uuid: "ccd348dbed854f12940183b7be1966c4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43783 } } peers { permanent_uuid: "d2ef54160cb2471ea1d740709d6446b7" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 38913 } }
I20260615 08:08:46.189430 14772 ts_tablet_manager.cc:1434] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260615 08:08:46.189463 14606 heartbeater.cc:499] Master 127.4.42.254:41635 was elected leader, sending a full tablet report...
I20260615 08:08:46.189558 14773 ts_tablet_manager.cc:1434] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260615 08:08:46.189584 14757 heartbeater.cc:499] Master 127.4.42.254:41635 was elected leader, sending a full tablet report...
I20260615 08:08:46.189982 14774 tablet_bootstrap.cc:654] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968: Neither blocks nor log segments found. Creating new log.
I20260615 08:08:46.190574 14774 tablet_bootstrap.cc:492] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968: No bootstrap required, opened a new log
I20260615 08:08:46.190644 14774 ts_tablet_manager.cc:1403] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260615 08:08:46.190785 14774 raft_consensus.cc:359] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3526be60373413cbbfba3ff5de65968" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38477 } } peers { permanent_uuid: "ccd348dbed854f12940183b7be1966c4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43783 } } peers { permanent_uuid: "d2ef54160cb2471ea1d740709d6446b7" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 38913 } }
I20260615 08:08:46.190860 14774 raft_consensus.cc:385] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:08:46.190881 14774 raft_consensus.cc:740] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3526be60373413cbbfba3ff5de65968, State: Initialized, Role: FOLLOWER
I20260615 08:08:46.190923 14774 consensus_queue.cc:260] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3526be60373413cbbfba3ff5de65968" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38477 } } peers { permanent_uuid: "ccd348dbed854f12940183b7be1966c4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43783 } } peers { permanent_uuid: "d2ef54160cb2471ea1d740709d6446b7" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 38913 } }
I20260615 08:08:46.191098 14774 ts_tablet_manager.cc:1434] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260615 08:08:46.191143 14682 heartbeater.cc:499] Master 127.4.42.254:41635 was elected leader, sending a full tablet report...
W20260615 08:08:46.193123 14607 tablet.cc:2404] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260615 08:08:46.320252 14780 raft_consensus.cc:493] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260615 08:08:46.320348 14780 raft_consensus.cc:515] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3526be60373413cbbfba3ff5de65968" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38477 } } peers { permanent_uuid: "ccd348dbed854f12940183b7be1966c4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43783 } } peers { permanent_uuid: "d2ef54160cb2471ea1d740709d6446b7" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 38913 } }
I20260615 08:08:46.320540 14780 leader_election.cc:290] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccd348dbed854f12940183b7be1966c4 (127.4.42.195:43783), d2ef54160cb2471ea1d740709d6446b7 (127.4.42.193:38913)
I20260615 08:08:46.323879 14580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aee5f7f624a45c0be14bc719f978693" candidate_uuid: "a3526be60373413cbbfba3ff5de65968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2ef54160cb2471ea1d740709d6446b7" is_pre_election: true
I20260615 08:08:46.323962 14580 raft_consensus.cc:2468] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3526be60373413cbbfba3ff5de65968 in term 0.
I20260615 08:08:46.323904 14731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aee5f7f624a45c0be14bc719f978693" candidate_uuid: "a3526be60373413cbbfba3ff5de65968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd348dbed854f12940183b7be1966c4" is_pre_election: true
I20260615 08:08:46.324010 14731 raft_consensus.cc:2468] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3526be60373413cbbfba3ff5de65968 in term 0.
I20260615 08:08:46.324128 14621 leader_election.cc:304] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a3526be60373413cbbfba3ff5de65968, d2ef54160cb2471ea1d740709d6446b7; no voters:
I20260615 08:08:46.324224 14780 raft_consensus.cc:2804] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260615 08:08:46.324262 14780 raft_consensus.cc:493] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:08:46.324294 14780 raft_consensus.cc:3060] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:08:46.324985 14780 raft_consensus.cc:515] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3526be60373413cbbfba3ff5de65968" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38477 } } peers { permanent_uuid: "ccd348dbed854f12940183b7be1966c4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43783 } } peers { permanent_uuid: "d2ef54160cb2471ea1d740709d6446b7" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 38913 } }
I20260615 08:08:46.325153 14780 leader_election.cc:290] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968 [CANDIDATE]: Term 1 election: Requested vote from peers ccd348dbed854f12940183b7be1966c4 (127.4.42.195:43783), d2ef54160cb2471ea1d740709d6446b7 (127.4.42.193:38913)
I20260615 08:08:46.325255 14731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aee5f7f624a45c0be14bc719f978693" candidate_uuid: "a3526be60373413cbbfba3ff5de65968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccd348dbed854f12940183b7be1966c4"
I20260615 08:08:46.325281 14580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aee5f7f624a45c0be14bc719f978693" candidate_uuid: "a3526be60373413cbbfba3ff5de65968" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2ef54160cb2471ea1d740709d6446b7"
I20260615 08:08:46.325322 14731 raft_consensus.cc:3060] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:08:46.325330 14580 raft_consensus.cc:3060] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:08:46.326028 14580 raft_consensus.cc:2468] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3526be60373413cbbfba3ff5de65968 in term 1.
I20260615 08:08:46.326028 14731 raft_consensus.cc:2468] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3526be60373413cbbfba3ff5de65968 in term 1.
I20260615 08:08:46.326222 14621 leader_election.cc:304] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a3526be60373413cbbfba3ff5de65968, d2ef54160cb2471ea1d740709d6446b7; no voters:
I20260615 08:08:46.326344 14780 raft_consensus.cc:2804] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968 [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:08:46.326536 14780 raft_consensus.cc:697] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968 [term 1 LEADER]: Becoming Leader. State: Replica: a3526be60373413cbbfba3ff5de65968, State: Running, Role: LEADER
I20260615 08:08:46.326591 14780 consensus_queue.cc:237] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3526be60373413cbbfba3ff5de65968" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38477 } } peers { permanent_uuid: "ccd348dbed854f12940183b7be1966c4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43783 } } peers { permanent_uuid: "d2ef54160cb2471ea1d740709d6446b7" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 38913 } }
I20260615 08:08:46.327082 14476 catalog_manager.cc:5696] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3526be60373413cbbfba3ff5de65968 (127.4.42.194). New cstate: current_term: 1 leader_uuid: "a3526be60373413cbbfba3ff5de65968" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3526be60373413cbbfba3ff5de65968" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccd348dbed854f12940183b7be1966c4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2ef54160cb2471ea1d740709d6446b7" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 38913 } health_report { overall_health: UNKNOWN } } }
I20260615 08:08:46.368846 14731 raft_consensus.cc:1275] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4 [term 1 FOLLOWER]: Refusing update from remote peer a3526be60373413cbbfba3ff5de65968: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:08:46.368846 14580 raft_consensus.cc:1275] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7 [term 1 FOLLOWER]: Refusing update from remote peer a3526be60373413cbbfba3ff5de65968: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:08:46.369095 14782 consensus_queue.cc:1048] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd348dbed854f12940183b7be1966c4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:08:46.369220 14780 consensus_queue.cc:1048] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2ef54160cb2471ea1d740709d6446b7" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 38913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:08:46.491822 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:46.497335 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:46.497464 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:46.552734 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.051s user 0.014s sys 0.003s Metrics: {"bytes_written":276456,"cfile_init":1,"dirs.queue_time_us":42,"dirs.run_cpu_time_us":119,"dirs.run_wall_time_us":484,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":726,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9600}
I20260615 08:08:46.553426 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 88475 bytes on disk
I20260615 08:08:46.553673 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":21,"lbm_reads_lt_1ms":4}
I20260615 08:08:46.554702 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.063s user 0.012s sys 0.007s Metrics: {"bytes_written":276456,"cfile_init":1,"compiler_manager_pool.queue_time_us":142,"dirs.queue_time_us":34,"dirs.run_cpu_time_us":117,"dirs.run_wall_time_us":464,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":641,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9600,"thread_start_us":114,"threads_started":1}
I20260615 08:08:46.554824 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 88475 bytes on disk
I20260615 08:08:46.555471 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:08:46.555927 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.058s user 0.015s sys 0.004s Metrics: {"bytes_written":281583,"cfile_init":1,"dirs.queue_time_us":21,"dirs.run_cpu_time_us":156,"dirs.run_wall_time_us":717,"drs_written":1,"lbm_read_time_us":26,"lbm_reads_lt_1ms":4,"lbm_write_time_us":720,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9800}
I20260615 08:08:46.556041 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 90389 bytes on disk
I20260615 08:08:46.556156 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":21,"lbm_reads_lt_1ms":4}
I20260615 08:08:46.687407 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:46.695456 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:46.697765 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:46.713470 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.026s user 0.010s sys 0.002s Metrics: {"bytes_written":273715,"cfile_init":1,"dirs.queue_time_us":46,"dirs.run_cpu_time_us":157,"dirs.run_wall_time_us":580,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":632,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9500,"spinlock_wait_cycles":768}
I20260615 08:08:46.713778 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 87594 bytes on disk
I20260615 08:08:46.716635 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":23,"lbm_reads_lt_1ms":4}
I20260615 08:08:46.716760 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.014707
I20260615 08:08:46.717108 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.019s user 0.011s sys 0.001s Metrics: {"bytes_written":273801,"cfile_init":1,"dirs.queue_time_us":30,"dirs.run_cpu_time_us":111,"dirs.run_wall_time_us":612,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":578,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9500}
I20260615 08:08:46.717232 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 87563 bytes on disk
I20260615 08:08:46.717343 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4}
I20260615 08:08:46.717445 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.014705
I20260615 08:08:46.732041 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.036s user 0.013s sys 0.000s Metrics: {"bytes_written":277804,"cfile_init":1,"dirs.queue_time_us":23,"dirs.run_cpu_time_us":93,"dirs.run_wall_time_us":429,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":676,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9650}
I20260615 08:08:46.736004 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 89029 bytes on disk
I20260615 08:08:46.736171 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4}
I20260615 08:08:46.736310 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.014705
I20260615 08:08:46.761386 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.045s user 0.025s sys 0.004s Metrics: {"bytes_written":546274,"cfile_cache_hit":12,"cfile_cache_hit_bytes":419907,"cfile_cache_miss":40,"cfile_cache_miss_bytes":932151,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":51,"dirs.run_cpu_time_us":102,"dirs.run_wall_time_us":420,"drs_written":1,"lbm_read_time_us":3017,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":59,"lbm_write_time_us":1110,"lbm_writes_lt_1ms":43,"num_input_rowsets":2,"peak_mem_usage":292759,"rows_written":19100,"thread_start_us":211,"threads_started":5}
I20260615 08:08:46.761561 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 184008 bytes on disk
I20260615 08:08:46.761768 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:08:46.771972 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.054s user 0.030s sys 0.000s Metrics: {"bytes_written":551486,"cfile_cache_hit":13,"cfile_cache_hit_bytes":454637,"cfile_cache_miss":39,"cfile_cache_miss_bytes":911613,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":246,"dirs.run_cpu_time_us":92,"dirs.run_wall_time_us":375,"drs_written":1,"lbm_read_time_us":539,"lbm_reads_lt_1ms":59,"lbm_write_time_us":1101,"lbm_writes_lt_1ms":43,"num_input_rowsets":2,"peak_mem_usage":295809,"rows_written":19300,"thread_start_us":278,"threads_started":5}
I20260615 08:08:46.772154 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 186005 bytes on disk
I20260615 08:08:46.772559 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20260615 08:08:46.792450 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.056s user 0.028s sys 0.000s Metrics: {"bytes_written":550158,"cfile_cache_hit":13,"cfile_cache_hit_bytes":452979,"cfile_cache_miss":39,"cfile_cache_miss_bytes":910123,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":65,"dirs.run_cpu_time_us":97,"dirs.run_wall_time_us":516,"drs_written":1,"lbm_read_time_us":521,"lbm_reads_lt_1ms":59,"lbm_write_time_us":1213,"lbm_writes_lt_1ms":43,"num_input_rowsets":2,"peak_mem_usage":293394,"rows_written":19250,"thread_start_us":287,"threads_started":5}
I20260615 08:08:46.792614 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 185547 bytes on disk
I20260615 08:08:46.792763 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:08:46.863445 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:46.863626 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:46.863718 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:46.876662 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.013s user 0.010s sys 0.000s Metrics: {"bytes_written":273835,"cfile_init":1,"dirs.queue_time_us":54,"dirs.run_cpu_time_us":128,"dirs.run_wall_time_us":618,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":499,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9500}
I20260615 08:08:46.876857 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.014387
I20260615 08:08:46.882781 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.019s user 0.011s sys 0.004s Metrics: {"bytes_written":275021,"cfile_init":1,"dirs.queue_time_us":27,"dirs.run_cpu_time_us":106,"dirs.run_wall_time_us":461,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":656,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9550}
I20260615 08:08:46.882929 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.019s user 0.013s sys 0.001s Metrics: {"bytes_written":279065,"cfile_init":1,"dirs.queue_time_us":24,"dirs.run_cpu_time_us":80,"dirs.run_wall_time_us":390,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":671,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9700}
I20260615 08:08:46.883003 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 88049 bytes on disk
I20260615 08:08:46.883074 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 89452 bytes on disk
I20260615 08:08:46.883144 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":22,"lbm_reads_lt_1ms":4}
I20260615 08:08:46.883272 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.014388
I20260615 08:08:46.886788 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:08:46.886934 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.014390
I20260615 08:08:46.927431 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.050s user 0.043s sys 0.000s Metrics: {"bytes_written":818285,"cfile_cache_hit":10,"cfile_cache_hit_bytes":441438,"cfile_cache_miss":52,"cfile_cache_miss_bytes":1606496,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":194,"dirs.run_cpu_time_us":283,"dirs.run_wall_time_us":1840,"drs_written":1,"lbm_read_time_us":943,"lbm_reads_lt_1ms":76,"lbm_write_time_us":1799,"lbm_writes_lt_1ms":54,"num_input_rowsets":2,"peak_mem_usage":440666,"rows_written":28800}
I20260615 08:08:46.927757 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 283615 bytes on disk
I20260615 08:08:46.929018 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:08:46.934055 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.051s user 0.035s sys 0.004s Metrics: {"bytes_written":818285,"cfile_cache_hit":10,"cfile_cache_hit_bytes":442403,"cfile_cache_miss":52,"cfile_cache_miss_bytes":1605283,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":857,"dirs.run_cpu_time_us":101,"dirs.run_wall_time_us":536,"drs_written":1,"lbm_read_time_us":1014,"lbm_reads_lt_1ms":72,"lbm_write_time_us":2031,"lbm_writes_lt_1ms":54,"num_input_rowsets":2,"peak_mem_usage":437361,"rows_written":28800}
I20260615 08:08:46.934453 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 283615 bytes on disk
I20260615 08:08:46.934612 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20260615 08:08:46.946058 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.058s user 0.038s sys 0.002s Metrics: {"bytes_written":818285,"cfile_cache_hit":10,"cfile_cache_hit_bytes":445288,"cfile_cache_miss":52,"cfile_cache_miss_bytes":1602448,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":30,"dirs.run_cpu_time_us":77,"dirs.run_wall_time_us":464,"drs_written":1,"lbm_read_time_us":907,"lbm_reads_lt_1ms":72,"lbm_write_time_us":1681,"lbm_writes_lt_1ms":54,"num_input_rowsets":2,"peak_mem_usage":440666,"rows_written":28800}
I20260615 08:08:46.946204 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 283615 bytes on disk
I20260615 08:08:46.946318 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20260615 08:08:47.046530 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:47.047544 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:47.050792 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:47.065779 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.015s user 0.014s sys 0.000s Metrics: {"bytes_written":283055,"cfile_init":1,"dirs.queue_time_us":35,"dirs.run_cpu_time_us":103,"dirs.run_wall_time_us":544,"drs_written":1,"lbm_read_time_us":314,"lbm_reads_lt_1ms":4,"lbm_write_time_us":674,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9850}
I20260615 08:08:47.065934 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1047556 bytes of WAL
I20260615 08:08:47.066021 14698 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:47.066069 14698 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000001 (ops 1-624)
I20260615 08:08:47.066550 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:47.066646 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 90762 bytes on disk
I20260615 08:08:47.066752 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20260615 08:08:47.066883 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.014420
I20260615 08:08:47.068143 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.018s user 0.013s sys 0.000s Metrics: {"bytes_written":283055,"cfile_init":1,"dirs.queue_time_us":105,"dirs.run_cpu_time_us":90,"dirs.run_wall_time_us":440,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1963,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"rows_written":9850}
I20260615 08:08:47.068293 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1052631 bytes of WAL
I20260615 08:08:47.069463 14466 maintenance_manager.cc:419] P 8441fd568a084c40a32d3b05578699b1: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.003577
I20260615 08:08:47.070142 14623 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:47.070178 14623 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000001 (ops 1-581)
I20260615 08:08:47.070586 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:47.070719 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.014420
I20260615 08:08:47.070749 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.024s user 0.013s sys 0.000s Metrics: {"bytes_written":281530,"cfile_init":1,"dirs.queue_time_us":2357,"dirs.run_cpu_time_us":74,"dirs.run_wall_time_us":348,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":629,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9800}
I20260615 08:08:47.070865 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1050457 bytes of WAL
I20260615 08:08:47.070923 14547 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:47.070942 14547 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000001 (ops 1-619)
I20260615 08:08:47.071276 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:47.071363 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 90286 bytes on disk
I20260615 08:08:47.071465 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20260615 08:08:47.071543 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.014420
I20260615 08:08:47.073283 14465 maintenance_manager.cc:643] P 8441fd568a084c40a32d3b05578699b1: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.004s user 0.002s sys 0.000s Metrics: {"bytes_written":6631,"cfile_init":1,"drs_written":1,"lbm_read_time_us":31,"lbm_reads_lt_1ms":4,"lbm_write_time_us":206,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":5,"thread_start_us":62,"threads_started":1}
I20260615 08:08:47.073421 14466 maintenance_manager.cc:419] P 8441fd568a084c40a32d3b05578699b1: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 484 bytes on disk
I20260615 08:08:47.073760 14465 maintenance_manager.cc:643] P 8441fd568a084c40a32d3b05578699b1: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:08:47.126379 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.055s user 0.048s sys 0.004s Metrics: {"bytes_written":1095106,"cfile_cache_hit":12,"cfile_cache_hit_bytes":615628,"cfile_cache_miss":62,"cfile_cache_miss_bytes":2140758,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":157,"dirs.run_cpu_time_us":226,"dirs.run_wall_time_us":1330,"drs_written":1,"lbm_read_time_us":1057,"lbm_reads_lt_1ms":82,"lbm_write_time_us":2080,"lbm_writes_lt_1ms":64,"num_input_rowsets":2,"peak_mem_usage":590091,"rows_written":38600}
I20260615 08:08:47.126631 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 384402 bytes on disk
I20260615 08:08:47.126761 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20260615 08:08:47.130086 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.063s user 0.049s sys 0.003s Metrics: {"bytes_written":1096197,"cfile_cache_hit":12,"cfile_cache_hit_bytes":616593,"cfile_cache_miss":62,"cfile_cache_miss_bytes":2143795,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":445,"dirs.run_cpu_time_us":90,"dirs.run_wall_time_us":411,"drs_written":1,"lbm_read_time_us":1050,"lbm_reads_lt_1ms":82,"lbm_write_time_us":2987,"lbm_writes_lt_1ms":64,"num_input_rowsets":2,"peak_mem_usage":589201,"rows_written":38650}
I20260615 08:08:47.130246 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 384817 bytes on disk
I20260615 08:08:47.130360 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:08:47.145514 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.074s user 0.047s sys 0.008s Metrics: {"bytes_written":1096197,"cfile_cache_hit":12,"cfile_cache_hit_bytes":616593,"cfile_cache_miss":62,"cfile_cache_miss_bytes":2143795,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":18,"dirs.run_cpu_time_us":81,"dirs.run_wall_time_us":380,"drs_written":1,"lbm_read_time_us":1277,"lbm_reads_lt_1ms":86,"lbm_write_time_us":2840,"lbm_writes_lt_1ms":64,"num_input_rowsets":2,"peak_mem_usage":589201,"rows_written":38650}
I20260615 08:08:47.145664 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 384817 bytes on disk
I20260615 08:08:47.145779 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20260615 08:08:47.241636 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:47.247205 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:47.248091 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:47.266929 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.019s user 0.013s sys 0.000s Metrics: {"bytes_written":277932,"cfile_init":1,"dirs.queue_time_us":28,"dirs.run_cpu_time_us":99,"dirs.run_wall_time_us":490,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":679,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9650}
I20260615 08:08:47.267339 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.014350
I20260615 08:08:47.295390 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.054s user 0.015s sys 0.000s Metrics: {"bytes_written":273706,"cfile_init":1,"dirs.queue_time_us":52,"dirs.run_cpu_time_us":105,"dirs.run_wall_time_us":748,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":708,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9500,"spinlock_wait_cycles":452352}
I20260615 08:08:47.295553 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.014351
I20260615 08:08:47.324805 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.077s user 0.014s sys 0.000s Metrics: {"bytes_written":286774,"cfile_init":1,"dirs.queue_time_us":1169,"dirs.run_cpu_time_us":92,"dirs.run_wall_time_us":534,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":699,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":10000}
I20260615 08:08:47.329818 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 92143 bytes on disk
I20260615 08:08:47.330583 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":347,"lbm_reads_lt_1ms":4}
I20260615 08:08:47.330716 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.014348
I20260615 08:08:47.345914 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.078s user 0.059s sys 0.007s Metrics: {"bytes_written":1365739,"cfile_cache_hit":12,"cfile_cache_hit_bytes":666918,"cfile_cache_miss":70,"cfile_cache_miss_bytes":2785052,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":5689,"dirs.run_cpu_time_us":364,"dirs.run_wall_time_us":2053,"drs_written":1,"lbm_read_time_us":1609,"lbm_reads_lt_1ms":94,"lbm_write_time_us":4130,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":75,"mutex_wait_us":1246,"num_input_rowsets":2,"peak_mem_usage":735583,"rows_written":48250}
I20260615 08:08:47.346073 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 484784 bytes on disk
I20260615 08:08:47.346323 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:08:47.418956 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.087s user 0.063s sys 0.000s Metrics: {"bytes_written":1375736,"cfile_cache_hit":12,"cfile_cache_hit_bytes":673471,"cfile_cache_miss":70,"cfile_cache_miss_bytes":2805931,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":80,"dirs.run_cpu_time_us":110,"dirs.run_wall_time_us":625,"drs_written":1,"lbm_read_time_us":7211,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":89,"lbm_write_time_us":4198,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":75,"num_input_rowsets":2,"peak_mem_usage":741688,"rows_written":48650}
I20260615 08:08:47.419350 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 488715 bytes on disk
I20260615 08:08:47.419595 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20260615 08:08:47.427269 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:47.433151 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.134s user 0.050s sys 0.013s Metrics: {"bytes_written":1363221,"cfile_cache_hit":12,"cfile_cache_hit_bytes":663846,"cfile_cache_miss":70,"cfile_cache_miss_bytes":2780056,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":621,"dirs.run_cpu_time_us":114,"dirs.run_wall_time_us":629,"drs_written":1,"lbm_read_time_us":8601,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":93,"lbm_write_time_us":6125,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":75,"num_input_rowsets":2,"peak_mem_usage":734063,"rows_written":48150}
I20260615 08:08:47.433344 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 483567 bytes on disk
I20260615 08:08:47.433874 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20260615 08:08:47.433981 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:47.440044 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:47.454068 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.020s user 0.010s sys 0.004s Metrics: {"bytes_written":277727,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":87,"dirs.run_wall_time_us":374,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":732,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9650}
I20260615 08:08:47.454259 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 88830 bytes on disk
I20260615 08:08:47.454375 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4}
I20260615 08:08:47.454478 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.014366
I20260615 08:08:47.454619 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.027s user 0.011s sys 0.003s Metrics: {"bytes_written":273700,"cfile_init":1,"dirs.queue_time_us":28,"dirs.run_cpu_time_us":89,"dirs.run_wall_time_us":431,"drs_written":1,"lbm_read_time_us":78,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1762,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9500}
I20260615 08:08:47.454742 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.014366
I20260615 08:08:47.484109 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.043s user 0.013s sys 0.001s Metrics: {"bytes_written":276516,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":111,"dirs.run_wall_time_us":532,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3040,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9600}
I20260615 08:08:47.484457 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 88388 bytes on disk
I20260615 08:08:47.484632 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4}
I20260615 08:08:47.484767 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.014362
I20260615 08:08:47.572592 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.118s user 0.075s sys 0.000s Metrics: {"bytes_written":1629624,"cfile_cache_hit":10,"cfile_cache_hit_bytes":441789,"cfile_cache_miss":84,"cfile_cache_miss_bytes":3691699,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":144,"dirs.run_cpu_time_us":101,"dirs.run_wall_time_us":620,"drs_written":1,"lbm_read_time_us":4987,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":106,"lbm_write_time_us":5344,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":85,"num_input_rowsets":2,"peak_mem_usage":880438,"rows_written":57750}
I20260615 08:08:47.572753 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 583929 bytes on disk
I20260615 08:08:47.572970 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20260615 08:08:47.593422 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:47.628320 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.031s user 0.014s sys 0.001s Metrics: {"bytes_written":286783,"cfile_init":1,"dirs.queue_time_us":24,"dirs.run_cpu_time_us":89,"dirs.run_wall_time_us":692,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1069,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":10000}
I20260615 08:08:47.628852 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1072214 bytes of WAL
I20260615 08:08:47.629220 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.175s user 0.076s sys 0.000s Metrics: {"bytes_written":1631109,"cfile_cache_hit":10,"cfile_cache_hit_bytes":444622,"cfile_cache_miss":84,"cfile_cache_miss_bytes":3692170,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":96,"dirs.run_wall_time_us":1033,"drs_written":1,"lbm_read_time_us":9780,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":102,"lbm_write_time_us":7919,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":84,"num_input_rowsets":2,"peak_mem_usage":879548,"rows_written":57800,"spinlock_wait_cycles":384}
I20260615 08:08:47.629382 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 584412 bytes on disk
I20260615 08:08:47.629508 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:08:47.629534 14547 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:47.629639 14547 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000002 (ops 620-1255)
I20260615 08:08:47.630131 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:47.630271 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 93382 bytes on disk
I20260615 08:08:47.630414 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":21,"lbm_reads_lt_1ms":4}
I20260615 08:08:47.630573 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.014294
I20260615 08:08:47.654317 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.169s user 0.078s sys 0.000s Metrics: {"bytes_written":1646242,"cfile_cache_hit":12,"cfile_cache_hit_bytes":611019,"cfile_cache_miss":82,"cfile_cache_miss_bytes":3557799,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":244,"dirs.run_cpu_time_us":79,"dirs.run_wall_time_us":431,"drs_written":1,"lbm_read_time_us":2616,"lbm_reads_lt_1ms":102,"lbm_write_time_us":5008,"lbm_writes_lt_1ms":88,"num_input_rowsets":2,"peak_mem_usage":888063,"rows_written":58250}
I20260615 08:08:47.654511 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:47.686436 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.032s user 0.018s sys 0.000s Metrics: {"bytes_written":370427,"cfile_init":1,"dirs.queue_time_us":30,"dirs.run_cpu_time_us":93,"dirs.run_wall_time_us":534,"drs_written":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2233,"lbm_writes_lt_1ms":35,"peak_mem_usage":0,"rows_written":12850}
I20260615 08:08:47.686668 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1098957 bytes of WAL
I20260615 08:08:47.686805 14623 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:47.686861 14623 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000002 (ops 582-1186)
I20260615 08:08:47.687296 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:47.687424 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 710187 bytes on disk
I20260615 08:08:47.687582 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":33,"lbm_reads_lt_1ms":8}
I20260615 08:08:47.687700 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.014258
I20260615 08:08:47.711338 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:47.800838 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.170s user 0.087s sys 0.001s Metrics: {"bytes_written":1911754,"cfile_cache_hit":13,"cfile_cache_hit_bytes":805065,"cfile_cache_miss":91,"cfile_cache_miss_bytes":4051299,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":24,"dirs.run_cpu_time_us":115,"dirs.run_wall_time_us":519,"drs_written":1,"lbm_read_time_us":3967,"lbm_reads_lt_1ms":111,"lbm_write_time_us":4926,"lbm_writes_lt_1ms":99,"num_input_rowsets":2,"peak_mem_usage":1032920,"rows_written":67750}
I20260615 08:08:47.802881 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 690913 bytes on disk
I20260615 08:08:47.803084 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20260615 08:08:47.803234 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:47.807744 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.096s user 0.015s sys 0.000s Metrics: {"bytes_written":300324,"cfile_init":1,"dirs.queue_time_us":2003,"dirs.run_cpu_time_us":115,"dirs.run_wall_time_us":765,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":9008,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":10350}
I20260615 08:08:47.807904 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1009926 bytes of WAL
I20260615 08:08:47.810420 14698 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:47.810462 14698 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000002 (ops 625-1228)
I20260615 08:08:47.810819 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:47.810907 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 96875 bytes on disk
I20260615 08:08:47.813853 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":21,"lbm_reads_lt_1ms":4}
I20260615 08:08:47.813962 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.014289
I20260615 08:08:47.833201 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.029s user 0.016s sys 0.003s Metrics: {"bytes_written":332958,"cfile_init":1,"dirs.queue_time_us":23,"dirs.run_cpu_time_us":81,"dirs.run_wall_time_us":433,"drs_written":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4,"lbm_write_time_us":871,"lbm_writes_lt_1ms":34,"peak_mem_usage":0,"rows_written":11600}
I20260615 08:08:47.833650 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.014100
I20260615 08:08:47.843791 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.156s user 0.085s sys 0.008s Metrics: {"bytes_written":2005013,"cfile_cache_hit":10,"cfile_cache_hit_bytes":506357,"cfile_cache_miss":98,"cfile_cache_miss_bytes":4591565,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":165,"dirs.run_cpu_time_us":107,"dirs.run_wall_time_us":553,"drs_written":1,"lbm_read_time_us":3644,"lbm_reads_lt_1ms":118,"lbm_write_time_us":4664,"lbm_writes_lt_1ms":104,"num_input_rowsets":2,"peak_mem_usage":1082351,"rows_written":71100,"spinlock_wait_cycles":896}
I20260615 08:08:47.843933 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 729276 bytes on disk
I20260615 08:08:47.844028 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20260615 08:08:47.854207 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:47.873522 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.019s user 0.003s sys 0.010s Metrics: {"bytes_written":279120,"cfile_init":1,"dirs.queue_time_us":19,"dirs.run_cpu_time_us":102,"dirs.run_wall_time_us":554,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1064,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9700}
I20260615 08:08:47.873658 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.014082
I20260615 08:08:47.936296 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.121s user 0.080s sys 0.003s Metrics: {"bytes_written":1922346,"cfile_cache_hit":13,"cfile_cache_hit_bytes":813636,"cfile_cache_miss":91,"cfile_cache_miss_bytes":4072488,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":36,"dirs.run_cpu_time_us":107,"dirs.run_wall_time_us":552,"drs_written":1,"lbm_read_time_us":2662,"lbm_reads_lt_1ms":111,"lbm_write_time_us":4247,"lbm_writes_lt_1ms":99,"num_input_rowsets":2,"peak_mem_usage":1039020,"rows_written":68150}
I20260615 08:08:47.936451 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:47.963420 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.027s user 0.019s sys 0.000s Metrics: {"bytes_written":425915,"cfile_init":1,"dirs.queue_time_us":27,"dirs.run_cpu_time_us":89,"dirs.run_wall_time_us":486,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":836,"lbm_writes_lt_1ms":38,"peak_mem_usage":0,"rows_written":14850}
I20260615 08:08:47.963997 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.014066
I20260615 08:08:47.987458 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.154s user 0.093s sys 0.012s Metrics: {"bytes_written":2236815,"cfile_cache_hit":10,"cfile_cache_hit_bytes":482401,"cfile_cache_miss":110,"cfile_cache_miss_bytes":5215283,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":71,"dirs.run_cpu_time_us":83,"dirs.run_wall_time_us":371,"drs_written":1,"lbm_read_time_us":3576,"lbm_reads_lt_1ms":134,"lbm_write_time_us":4938,"lbm_writes_lt_1ms":113,"num_input_rowsets":2,"peak_mem_usage":1209793,"rows_written":79350}
I20260615 08:08:47.987748 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 822514 bytes on disk
I20260615 08:08:47.987914 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20260615 08:08:47.989513 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.116s user 0.094s sys 0.004s Metrics: {"bytes_written":2278176,"cfile_cache_hit":12,"cfile_cache_hit_bytes":808307,"cfile_cache_miss":112,"cfile_cache_miss_bytes":4999923,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":24,"dirs.run_cpu_time_us":81,"dirs.run_wall_time_us":647,"drs_written":1,"lbm_read_time_us":2633,"lbm_reads_lt_1ms":136,"lbm_write_time_us":4282,"lbm_writes_lt_1ms":114,"num_input_rowsets":2,"peak_mem_usage":1236829,"rows_written":80800}
I20260615 08:08:47.989640 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 838587 bytes on disk
I20260615 08:08:47.989735 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20260615 08:08:48.079070 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:48.079849 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.116s user 0.102s sys 0.000s Metrics: {"bytes_written":2339239,"cfile_cache_hit":11,"cfile_cache_hit_bytes":570497,"cfile_cache_miss":113,"cfile_cache_miss_bytes":5389919,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":423,"dirs.run_cpu_time_us":122,"dirs.run_wall_time_us":614,"drs_written":1,"lbm_read_time_us":2432,"lbm_reads_lt_1ms":141,"lbm_write_time_us":5673,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":116,"num_input_rowsets":2,"peak_mem_usage":1264127,"rows_written":83000,"spinlock_wait_cycles":384}
I20260615 08:08:48.080121 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 863171 bytes on disk
I20260615 08:08:48.080272 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20260615 08:08:48.094548 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.015s user 0.011s sys 0.002s Metrics: {"bytes_written":273763,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":86,"dirs.run_wall_time_us":536,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":718,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9500}
I20260615 08:08:48.094702 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 87343 bytes on disk
I20260615 08:08:48.095059 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:08:48.095185 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.013893
I20260615 08:08:48.111202 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:48.125830 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.014s user 0.013s sys 0.000s Metrics: {"bytes_written":279056,"cfile_init":1,"dirs.queue_time_us":28,"dirs.run_cpu_time_us":115,"dirs.run_wall_time_us":538,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":682,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9700}
I20260615 08:08:48.126035 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1053305 bytes of WAL
I20260615 08:08:48.126161 14623 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:48.126242 14623 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000003 (ops 1187-1766)
I20260615 08:08:48.126685 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:48.126823 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 89228 bytes on disk
I20260615 08:08:48.126987 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":21,"lbm_reads_lt_1ms":4}
I20260615 08:08:48.127123 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.013966
I20260615 08:08:48.161285 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:48.184769 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.023s user 0.013s sys 0.000s Metrics: {"bytes_written":276421,"cfile_init":1,"dirs.queue_time_us":26,"dirs.run_cpu_time_us":101,"dirs.run_wall_time_us":463,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1609,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"rows_written":9600}
I20260615 08:08:48.185523 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.013944
I20260615 08:08:48.236507 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.109s user 0.097s sys 0.011s Metrics: {"bytes_written":2545073,"cfile_cache_hit":13,"cfile_cache_hit_bytes":835596,"cfile_cache_miss":119,"cfile_cache_miss_bytes":5688062,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":275,"dirs.run_cpu_time_us":107,"dirs.run_wall_time_us":541,"drs_written":1,"lbm_read_time_us":2468,"lbm_reads_lt_1ms":139,"lbm_write_time_us":4539,"lbm_writes_lt_1ms":125,"num_input_rowsets":2,"peak_mem_usage":1394445,"rows_written":90500}
I20260615 08:08:48.236665 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 947618 bytes on disk
I20260615 08:08:48.236768 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20260615 08:08:48.299823 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.204s user 0.098s sys 0.009s Metrics: {"bytes_written":2498417,"cfile_cache_hit":12,"cfile_cache_hit_bytes":651793,"cfile_cache_miss":120,"cfile_cache_miss_bytes":5750883,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":144,"dirs.run_cpu_time_us":95,"dirs.run_wall_time_us":484,"drs_written":1,"lbm_read_time_us":17303,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":139,"lbm_write_time_us":5580,"lbm_writes_lt_1ms":123,"num_input_rowsets":2,"peak_mem_usage":1366185,"rows_written":88850}
I20260615 08:08:48.299997 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:48.318351 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.018s user 0.014s sys 0.000s Metrics: {"bytes_written":284383,"cfile_init":1,"dirs.queue_time_us":26,"dirs.run_cpu_time_us":93,"dirs.run_wall_time_us":481,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":719,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9900}
I20260615 08:08:48.318528 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1055249 bytes of WAL
I20260615 08:08:48.318621 14547 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:48.318648 14547 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000003 (ops 1256-1868)
I20260615 08:08:48.319116 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:48.319202 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 1020298 bytes on disk
I20260615 08:08:48.319324 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":30,"lbm_reads_lt_1ms":8}
I20260615 08:08:48.319401 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.013931
I20260615 08:08:48.328019 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:48.356482 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.028s user 0.012s sys 0.000s Metrics: {"bytes_written":279235,"cfile_init":1,"dirs.queue_time_us":21,"dirs.run_cpu_time_us":83,"dirs.run_wall_time_us":454,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":742,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9700}
I20260615 08:08:48.356740 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 89323 bytes on disk
I20260615 08:08:48.356979 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20260615 08:08:48.357153 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.013822
I20260615 08:08:48.359258 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.173s user 0.098s sys 0.015s Metrics: {"bytes_written":2607175,"cfile_cache_hit":14,"cfile_cache_hit_bytes":880659,"cfile_cache_miss":122,"cfile_cache_miss_bytes":5799007,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":509,"dirs.run_cpu_time_us":220,"dirs.run_wall_time_us":1142,"drs_written":1,"lbm_read_time_us":3311,"lbm_reads_lt_1ms":146,"lbm_write_time_us":6244,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":127,"num_input_rowsets":2,"peak_mem_usage":1428669,"rows_written":92600}
I20260615 08:08:48.359400 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 971168 bytes on disk
I20260615 08:08:48.359927 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20260615 08:08:48.390395 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:48.411063 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.021s user 0.014s sys 0.000s Metrics: {"bytes_written":272543,"cfile_init":1,"dirs.queue_time_us":26,"dirs.run_cpu_time_us":111,"dirs.run_wall_time_us":611,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":615,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9450}
I20260615 08:08:48.411214 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1054248 bytes of WAL
I20260615 08:08:48.411284 14698 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:48.411311 14698 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000003 (ops 1229-1860)
I20260615 08:08:48.411666 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:48.411741 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 86960 bytes on disk
I20260615 08:08:48.412286 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20260615 08:08:48.412417 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.013876
I20260615 08:08:48.468243 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.149s user 0.114s sys 0.005s Metrics: {"bytes_written":2776109,"cfile_cache_hit":12,"cfile_cache_hit_bytes":806815,"cfile_cache_miss":130,"cfile_cache_miss_bytes":6319989,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":440,"dirs.run_cpu_time_us":127,"dirs.run_wall_time_us":586,"drs_written":1,"lbm_read_time_us":3493,"lbm_reads_lt_1ms":150,"lbm_write_time_us":5869,"lbm_writes_lt_1ms":135,"num_input_rowsets":2,"peak_mem_usage":1526651,"rows_written":98750}
I20260615 08:08:48.468427 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 1039614 bytes on disk
I20260615 08:08:48.469034 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4}
I20260615 08:08:48.503155 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.145s user 0.113s sys 0.009s Metrics: {"bytes_written":2816178,"cfile_cache_hit":13,"cfile_cache_hit_bytes":833073,"cfile_cache_miss":131,"cfile_cache_miss_bytes":6401789,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":316,"dirs.run_cpu_time_us":108,"dirs.run_wall_time_us":487,"drs_written":1,"lbm_read_time_us":4671,"lbm_reads_lt_1ms":151,"lbm_write_time_us":6278,"lbm_writes_lt_1ms":137,"num_input_rowsets":2,"peak_mem_usage":1552060,"rows_written":100200}
I20260615 08:08:48.503355 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 1055746 bytes on disk
I20260615 08:08:48.503489 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:08:48.566852 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.154s user 0.108s sys 0.019s Metrics: {"bytes_written":2867146,"cfile_cache_hit":11,"cfile_cache_hit_bytes":618953,"cfile_cache_miss":135,"cfile_cache_miss_bytes":6752649,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":278,"dirs.run_cpu_time_us":127,"dirs.run_wall_time_us":528,"drs_written":1,"lbm_read_time_us":3485,"lbm_reads_lt_1ms":155,"lbm_write_time_us":6425,"lbm_writes_lt_1ms":139,"num_input_rowsets":2,"peak_mem_usage":1580719,"rows_written":102050}
I20260615 08:08:48.567090 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 1076502 bytes on disk
I20260615 08:08:48.567281 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20260615 08:08:48.570470 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:48.592442 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.022s user 0.014s sys 0.000s Metrics: {"bytes_written":281708,"cfile_init":1,"dirs.queue_time_us":30,"dirs.run_cpu_time_us":98,"dirs.run_wall_time_us":585,"drs_written":1,"lbm_read_time_us":27,"lbm_reads_lt_1ms":4,"lbm_write_time_us":762,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9800}
I20260615 08:08:48.592613 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.013535
I20260615 08:08:48.595165 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:48.612234 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.017s user 0.011s sys 0.002s Metrics: {"bytes_written":280314,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":101,"dirs.run_wall_time_us":559,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":772,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9750}
I20260615 08:08:48.613381 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.013520
I20260615 08:08:48.648626 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:48.688984 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.040s user 0.011s sys 0.004s Metrics: {"bytes_written":276459,"cfile_init":1,"dirs.queue_time_us":22,"dirs.run_cpu_time_us":95,"dirs.run_wall_time_us":694,"drs_written":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2534,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"rows_written":9600}
I20260615 08:08:48.690558 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 89125 bytes on disk
I20260615 08:08:48.690750 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4}
I20260615 08:08:48.690933 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.013736
I20260615 08:08:48.722146 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.129s user 0.121s sys 0.004s Metrics: {"bytes_written":3051675,"cfile_cache_hit":12,"cfile_cache_hit_bytes":801609,"cfile_cache_miss":142,"cfile_cache_miss_bytes":7045289,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":309,"dirs.run_cpu_time_us":92,"dirs.run_wall_time_us":431,"drs_written":1,"lbm_read_time_us":3450,"lbm_reads_lt_1ms":166,"lbm_write_time_us":5782,"lbm_writes_lt_1ms":146,"num_input_rowsets":2,"peak_mem_usage":1685991,"rows_written":108550}
I20260615 08:08:48.723757 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 1148511 bytes on disk
I20260615 08:08:48.724041 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":29,"lbm_reads_lt_1ms":4}
I20260615 08:08:48.786002 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:48.796710 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.183s user 0.132s sys 0.008s Metrics: {"bytes_written":3091734,"cfile_cache_hit":12,"cfile_cache_hit_bytes":634303,"cfile_cache_miss":144,"cfile_cache_miss_bytes":7313099,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":145,"dirs.run_cpu_time_us":138,"dirs.run_wall_time_us":511,"drs_written":1,"lbm_read_time_us":4096,"lbm_reads_lt_1ms":168,"lbm_write_time_us":9171,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":147,"num_input_rowsets":2,"peak_mem_usage":1708785,"rows_written":109950,"spinlock_wait_cycles":384}
I20260615 08:08:48.796936 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 1164392 bytes on disk
I20260615 08:08:48.797041 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20260615 08:08:48.811717 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.026s user 0.012s sys 0.003s Metrics: {"bytes_written":272558,"cfile_init":1,"dirs.queue_time_us":27,"dirs.run_cpu_time_us":118,"dirs.run_wall_time_us":711,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1201,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9450}
I20260615 08:08:48.811955 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.013496
I20260615 08:08:48.827634 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:48.857955 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.029s user 0.015s sys 0.000s Metrics: {"bytes_written":280308,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":119,"dirs.run_wall_time_us":539,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":840,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9750}
I20260615 08:08:48.858842 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1047907 bytes of WAL
I20260615 08:08:48.859014 14623 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:48.859661 14623 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000004 (ops 1767-2343)
I20260615 08:08:48.860121 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:48.860240 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 89861 bytes on disk
I20260615 08:08:48.860378 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20260615 08:08:48.860513 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.013479
I20260615 08:08:48.900481 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.209s user 0.125s sys 0.011s Metrics: {"bytes_written":3138629,"cfile_cache_hit":12,"cfile_cache_hit_bytes":641158,"cfile_cache_miss":146,"cfile_cache_miss_bytes":7432000,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":158,"dirs.run_cpu_time_us":182,"dirs.run_wall_time_us":1191,"drs_written":1,"lbm_read_time_us":4529,"lbm_reads_lt_1ms":166,"lbm_write_time_us":10207,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":150,"num_input_rowsets":2,"peak_mem_usage":1736559,"rows_written":111650,"spinlock_wait_cycles":39552}
I20260615 08:08:48.900657 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 1184080 bytes on disk
I20260615 08:08:48.900767 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20260615 08:08:48.900848 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:48.918232 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.017s user 0.014s sys 0.000s Metrics: {"bytes_written":288236,"cfile_init":1,"dirs.queue_time_us":59,"dirs.run_cpu_time_us":133,"dirs.run_wall_time_us":491,"drs_written":1,"lbm_read_time_us":21,"lbm_reads_lt_1ms":4,"lbm_write_time_us":616,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":10050}
I20260615 08:08:48.918424 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 92648 bytes on disk
I20260615 08:08:48.918586 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":36,"lbm_reads_lt_1ms":4}
I20260615 08:08:48.918721 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.013252
I20260615 08:08:48.987479 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.175s user 0.133s sys 0.008s Metrics: {"bytes_written":3315467,"cfile_cache_hit":12,"cfile_cache_hit_bytes":672355,"cfile_cache_miss":152,"cfile_cache_miss_bytes":7870543,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":160,"dirs.run_cpu_time_us":111,"dirs.run_wall_time_us":761,"drs_written":1,"lbm_read_time_us":3659,"lbm_reads_lt_1ms":176,"lbm_write_time_us":7503,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":157,"num_input_rowsets":2,"peak_mem_usage":1838236,"rows_written":118000,"spinlock_wait_cycles":384}
I20260615 08:08:48.987646 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 1256989 bytes on disk
I20260615 08:08:48.987757 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:08:49.051674 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.191s user 0.140s sys 0.001s Metrics: {"bytes_written":3359027,"cfile_cache_hit":11,"cfile_cache_hit_bytes":566454,"cfile_cache_miss":155,"cfile_cache_miss_bytes":8099640,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":61,"dirs.run_cpu_time_us":114,"dirs.run_wall_time_us":532,"drs_written":1,"lbm_read_time_us":4423,"lbm_reads_lt_1ms":175,"lbm_write_time_us":6374,"lbm_writes_lt_1ms":159,"num_input_rowsets":2,"peak_mem_usage":1865560,"rows_written":119700,"spinlock_wait_cycles":1536}
I20260615 08:08:49.051854 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 1276586 bytes on disk
I20260615 08:08:49.052067 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:08:49.059252 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:49.079182 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.020s user 0.010s sys 0.004s Metrics: {"bytes_written":280241,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":111,"dirs.run_wall_time_us":535,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1113,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9750}
I20260615 08:08:49.079347 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1041132 bytes of WAL
I20260615 08:08:49.079421 14547 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:49.079449 14547 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000004 (ops 1869-2482)
I20260615 08:08:49.079840 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:49.079946 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 89757 bytes on disk
I20260615 08:08:49.080065 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4}
I20260615 08:08:49.080159 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.013384
I20260615 08:08:49.092759 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.174s user 0.140s sys 0.008s Metrics: {"bytes_written":3419111,"cfile_cache_hit":10,"cfile_cache_hit_bytes":453079,"cfile_cache_miss":160,"cfile_cache_miss_bytes":8359393,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":297,"dirs.run_cpu_time_us":81,"dirs.run_wall_time_us":538,"drs_written":1,"lbm_read_time_us":5218,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":179,"lbm_write_time_us":7357,"lbm_writes_lt_1ms":162,"num_input_rowsets":2,"peak_mem_usage":1897759,"rows_written":121700,"spinlock_wait_cycles":2077952}
I20260615 08:08:49.093076 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 1299256 bytes on disk
I20260615 08:08:49.092753 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:49.093309 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:08:49.121440 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.028s user 0.013s sys 0.002s Metrics: {"bytes_written":275091,"cfile_init":1,"dirs.queue_time_us":22,"dirs.run_cpu_time_us":131,"dirs.run_wall_time_us":548,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1542,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9550}
I20260615 08:08:49.121599 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 87821 bytes on disk
I20260615 08:08:49.121762 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20260615 08:08:49.121874 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.013368
I20260615 08:08:49.154781 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:49.208988 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.054s user 0.016s sys 0.000s Metrics: {"bytes_written":304202,"cfile_init":1,"dirs.queue_time_us":24,"dirs.run_cpu_time_us":110,"dirs.run_wall_time_us":793,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1506,"lbm_writes_lt_1ms":33,"peak_mem_usage":0,"rows_written":10500}
I20260615 08:08:49.209327 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1067404 bytes of WAL
I20260615 08:08:49.210117 14698 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:49.210168 14698 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000004 (ops 1861-2493)
I20260615 08:08:49.210887 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:49.210992 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 96759 bytes on disk
I20260615 08:08:49.211102 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4}
I20260615 08:08:49.211196 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.013395
I20260615 08:08:49.257804 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.178s user 0.152s sys 0.008s Metrics: {"bytes_written":3584057,"cfile_cache_hit":12,"cfile_cache_hit_bytes":727173,"cfile_cache_miss":164,"cfile_cache_miss_bytes":8530069,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":152,"dirs.run_cpu_time_us":123,"dirs.run_wall_time_us":672,"drs_written":1,"lbm_read_time_us":5868,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":183,"lbm_write_time_us":8558,"lbm_writes_lt_1ms":169,"num_input_rowsets":2,"peak_mem_usage":1998016,"rows_written":127750,"spinlock_wait_cycles":384}
I20260615 08:08:49.257992 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 1368425 bytes on disk
I20260615 08:08:49.258111 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20260615 08:08:49.288623 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:49.320536 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.032s user 0.012s sys 0.003s Metrics: {"bytes_written":281516,"cfile_init":1,"dirs.queue_time_us":17,"dirs.run_cpu_time_us":111,"dirs.run_wall_time_us":580,"drs_written":1,"lbm_read_time_us":23,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2825,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"rows_written":9800}
I20260615 08:08:49.321067 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 90228 bytes on disk
I20260615 08:08:49.321179 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20260615 08:08:49.321271 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.013381
I20260615 08:08:49.375299 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.253s user 0.154s sys 0.005s Metrics: {"bytes_written":3626113,"cfile_cache_hit":12,"cfile_cache_hit_bytes":732255,"cfile_cache_miss":166,"cfile_cache_miss_bytes":8637121,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":419,"dirs.run_cpu_time_us":89,"dirs.run_wall_time_us":430,"drs_written":1,"lbm_read_time_us":6786,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":185,"lbm_write_time_us":14806,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":168,"num_input_rowsets":2,"peak_mem_usage":2022585,"rows_written":129250,"spinlock_wait_cycles":384}
I20260615 08:08:49.376760 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:49.400938 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.189s user 0.148s sys 0.010s Metrics: {"bytes_written":3710385,"cfile_cache_hit":11,"cfile_cache_hit_bytes":494495,"cfile_cache_miss":169,"cfile_cache_miss_bytes":9091779,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":28,"dirs.run_cpu_time_us":128,"dirs.run_wall_time_us":617,"drs_written":1,"lbm_read_time_us":4010,"lbm_reads_lt_1ms":189,"lbm_write_time_us":8084,"lbm_writes_lt_1ms":176,"num_input_rowsets":2,"peak_mem_usage":2071224,"rows_written":132200}
I20260615 08:08:49.401110 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:49.410444 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.032s user 0.014s sys 0.004s Metrics: {"bytes_written":357223,"cfile_init":1,"dirs.queue_time_us":22,"dirs.run_cpu_time_us":84,"dirs.run_wall_time_us":514,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3232,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":34,"peak_mem_usage":0,"rows_written":12350}
I20260615 08:08:49.410668 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 1500265 bytes on disk
I20260615 08:08:49.411489 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":597,"lbm_reads_lt_1ms":8}
I20260615 08:08:49.411654 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.013341
I20260615 08:08:49.416445 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.015s user 0.014s sys 0.000s Metrics: {"bytes_written":301403,"cfile_init":1,"dirs.queue_time_us":62,"dirs.run_cpu_time_us":99,"dirs.run_wall_time_us":451,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":721,"lbm_writes_lt_1ms":33,"peak_mem_usage":0,"rows_written":10400}
I20260615 08:08:49.416567 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.013259
I20260615 08:08:49.586127 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.169s user 0.152s sys 0.016s Metrics: {"bytes_written":3998827,"cfile_cache_hit":11,"cfile_cache_hit_bytes":492312,"cfile_cache_miss":185,"cfile_cache_miss_bytes":9859986,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":527,"dirs.run_cpu_time_us":106,"dirs.run_wall_time_us":653,"drs_written":1,"lbm_read_time_us":4862,"lbm_reads_lt_1ms":213,"lbm_write_time_us":7116,"lbm_writes_lt_1ms":188,"num_input_rowsets":2,"peak_mem_usage":2240314,"rows_written":142600,"spinlock_wait_cycles":1536}
I20260615 08:08:49.586297 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 1536972 bytes on disk
I20260615 08:08:49.586409 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20260615 08:08:49.644435 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.231s user 0.152s sys 0.019s Metrics: {"bytes_written":3969666,"cfile_cache_hit":10,"cfile_cache_hit_bytes":497560,"cfile_cache_miss":180,"cfile_cache_miss_bytes":9776060,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":395,"dirs.run_cpu_time_us":116,"dirs.run_wall_time_us":569,"drs_written":1,"lbm_read_time_us":6192,"lbm_reads_lt_1ms":200,"lbm_write_time_us":9845,"lbm_writes_lt_1ms":187,"num_input_rowsets":2,"peak_mem_usage":2218814,"rows_written":141600,"spinlock_wait_cycles":384}
I20260615 08:08:49.644827 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 1525846 bytes on disk
I20260615 08:08:49.645191 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:08:49.666006 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:49.667135 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.345s user 0.144s sys 0.034s Metrics: {"bytes_written":3860383,"cfile_cache_hit":11,"cfile_cache_hit_bytes":478936,"cfile_cache_miss":177,"cfile_cache_miss_bytes":9500648,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":900,"dirs.run_cpu_time_us":108,"dirs.run_wall_time_us":593,"drs_written":1,"lbm_read_time_us":10365,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":195,"lbm_write_time_us":12776,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":180,"num_input_rowsets":2,"peak_mem_usage":2157206,"rows_written":137550,"spinlock_wait_cycles":384}
I20260615 08:08:49.667384 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:49.687510 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:49.690181 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.024s user 0.009s sys 0.006s Metrics: {"bytes_written":277794,"cfile_init":1,"dirs.queue_time_us":21,"dirs.run_cpu_time_us":91,"dirs.run_wall_time_us":485,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":877,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9650}
I20260615 08:08:49.690374 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1051695 bytes of WAL
I20260615 08:08:49.690572 14623 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:49.690652 14623 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000005 (ops 2344-2922)
I20260615 08:08:49.691179 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:49.691274 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.013202
I20260615 08:08:49.691250 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.024s user 0.019s sys 0.000s Metrics: {"bytes_written":398251,"cfile_init":1,"dirs.queue_time_us":26,"dirs.run_cpu_time_us":95,"dirs.run_wall_time_us":383,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1015,"lbm_writes_lt_1ms":37,"peak_mem_usage":0,"rows_written":13750}
I20260615 08:08:49.691411 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.013207
I20260615 08:08:49.726419 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.038s user 0.014s sys 0.000s Metrics: {"bytes_written":273720,"cfile_init":1,"dirs.queue_time_us":21,"dirs.run_cpu_time_us":110,"dirs.run_wall_time_us":566,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":718,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9500}
I20260615 08:08:49.726663 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.013192
I20260615 08:08:49.874155 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.183s user 0.173s sys 0.004s Metrics: {"bytes_written":4243050,"cfile_cache_hit":10,"cfile_cache_hit_bytes":524669,"cfile_cache_miss":196,"cfile_cache_miss_bytes":10468135,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":22,"dirs.run_cpu_time_us":109,"dirs.run_wall_time_us":777,"drs_written":1,"lbm_read_time_us":4668,"lbm_reads_lt_1ms":224,"lbm_write_time_us":7932,"lbm_writes_lt_1ms":197,"num_input_rowsets":2,"peak_mem_usage":2375022,"rows_written":151300}
I20260615 08:08:49.876019 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 1635368 bytes on disk
I20260615 08:08:49.876202 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:08:49.897230 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.206s user 0.187s sys 0.000s Metrics: {"bytes_written":4241479,"cfile_cache_hit":11,"cfile_cache_hit_bytes":473546,"cfile_cache_miss":197,"cfile_cache_miss_bytes":10516906,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":177,"dirs.run_cpu_time_us":87,"dirs.run_wall_time_us":573,"drs_written":1,"lbm_read_time_us":6482,"lbm_reads_lt_1ms":221,"lbm_write_time_us":8518,"lbm_writes_lt_1ms":197,"num_input_rowsets":2,"peak_mem_usage":2379964,"rows_written":151250,"spinlock_wait_cycles":1536}
I20260615 08:08:49.897504 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 1635044 bytes on disk
I20260615 08:08:49.898231 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:08:49.959328 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:49.960832 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:49.972005 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.012s user 0.011s sys 0.000s Metrics: {"bytes_written":280299,"cfile_init":1,"dirs.queue_time_us":43,"dirs.run_cpu_time_us":110,"dirs.run_wall_time_us":612,"drs_written":1,"lbm_read_time_us":12,"lbm_reads_lt_1ms":4,"lbm_write_time_us":570,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9750}
I20260615 08:08:49.972208 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.013184
I20260615 08:08:49.980422 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.019s user 0.014s sys 0.000s Metrics: {"bytes_written":280325,"cfile_init":1,"dirs.queue_time_us":67,"dirs.run_cpu_time_us":103,"dirs.run_wall_time_us":386,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":648,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9750}
I20260615 08:08:49.980736 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1055856 bytes of WAL
I20260615 08:08:49.980846 14547 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:49.980911 14547 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000005 (ops 2483-3105)
I20260615 08:08:49.981709 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:49.981913 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.013184
I20260615 08:08:49.996703 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.270s user 0.172s sys 0.008s Metrics: {"bytes_written":4263472,"cfile_cache_hit":11,"cfile_cache_hit_bytes":615888,"cfile_cache_miss":197,"cfile_cache_miss_bytes":10436726,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":155,"dirs.run_cpu_time_us":108,"dirs.run_wall_time_us":758,"drs_written":1,"lbm_read_time_us":6110,"lbm_reads_lt_1ms":221,"lbm_write_time_us":9362,"lbm_writes_lt_1ms":198,"num_input_rowsets":2,"peak_mem_usage":2395579,"rows_written":152100,"spinlock_wait_cycles":768}
I20260615 08:08:49.996978 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 1644910 bytes on disk
I20260615 08:08:49.997180 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:08:49.997349 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:50.012801 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.015s user 0.009s sys 0.004s Metrics: {"bytes_written":279176,"cfile_init":1,"dirs.queue_time_us":19,"dirs.run_cpu_time_us":89,"dirs.run_wall_time_us":437,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":646,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9700}
I20260615 08:08:50.013041 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1087031 bytes of WAL
I20260615 08:08:50.013254 14698 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:50.013340 14698 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000005 (ops 2494-3131)
I20260615 08:08:50.013787 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:50.013939 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 89427 bytes on disk
I20260615 08:08:50.014127 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20260615 08:08:50.014298 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.013167
I20260615 08:08:50.207469 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.193s user 0.177s sys 0.012s Metrics: {"bytes_written":4534037,"cfile_cache_hit":10,"cfile_cache_hit_bytes":446819,"cfile_cache_miss":208,"cfile_cache_miss_bytes":11322901,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":915,"dirs.run_cpu_time_us":105,"dirs.run_wall_time_us":466,"drs_written":1,"lbm_read_time_us":5306,"lbm_reads_lt_1ms":228,"lbm_write_time_us":7952,"lbm_writes_lt_1ms":210,"num_input_rowsets":2,"peak_mem_usage":2552989,"rows_written":161800}
I20260615 08:08:50.208293 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 1757142 bytes on disk
I20260615 08:08:50.208505 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20260615 08:08:50.212009 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.240s user 0.189s sys 0.012s Metrics: {"bytes_written":4513727,"cfile_cache_hit":10,"cfile_cache_hit_bytes":447762,"cfile_cache_miss":206,"cfile_cache_miss_bytes":11261326,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":43,"dirs.run_cpu_time_us":109,"dirs.run_wall_time_us":621,"drs_written":1,"lbm_read_time_us":5985,"lbm_reads_lt_1ms":230,"lbm_write_time_us":10441,"lbm_writes_lt_1ms":209,"num_input_rowsets":2,"peak_mem_usage":2536640,"rows_written":161000}
I20260615 08:08:50.212492 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 1748173 bytes on disk
I20260615 08:08:50.212658 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:08:50.254550 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.273s user 0.166s sys 0.026s Metrics: {"bytes_written":4514353,"cfile_cache_hit":10,"cfile_cache_hit_bytes":447763,"cfile_cache_miss":206,"cfile_cache_miss_bytes":11265189,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":1157,"dirs.run_cpu_time_us":113,"dirs.run_wall_time_us":590,"drs_written":1,"lbm_read_time_us":8953,"lbm_reads_lt_1ms":230,"lbm_write_time_us":11003,"lbm_writes_lt_1ms":209,"num_input_rowsets":2,"peak_mem_usage":2539105,"rows_written":161050,"spinlock_wait_cycles":896}
I20260615 08:08:50.255345 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 1748734 bytes on disk
I20260615 08:08:50.256222 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20260615 08:08:50.283933 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:50.286942 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:50.303778 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.017s user 0.010s sys 0.002s Metrics: {"bytes_written":276339,"cfile_init":1,"dirs.queue_time_us":76,"dirs.run_cpu_time_us":81,"dirs.run_wall_time_us":501,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":889,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9600}
I20260615 08:08:50.303949 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 88428 bytes on disk
I20260615 08:08:50.304106 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":25,"lbm_reads_lt_1ms":4}
I20260615 08:08:50.304270 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.013113
I20260615 08:08:50.309979 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:50.310803 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.027s user 0.009s sys 0.004s Metrics: {"bytes_written":276412,"cfile_init":1,"dirs.queue_time_us":30,"dirs.run_cpu_time_us":149,"dirs.run_wall_time_us":708,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1940,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"rows_written":9600}
I20260615 08:08:50.314558 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.013113
I20260615 08:08:50.330014 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.020s user 0.014s sys 0.000s Metrics: {"bytes_written":275060,"cfile_init":1,"dirs.queue_time_us":23,"dirs.run_cpu_time_us":93,"dirs.run_wall_time_us":487,"drs_written":1,"lbm_read_time_us":37,"lbm_reads_lt_1ms":4,"lbm_write_time_us":749,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9550}
I20260615 08:08:50.330245 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 88006 bytes on disk
I20260615 08:08:50.332723 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4}
I20260615 08:08:50.333292 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.012921
I20260615 08:08:50.612701 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.308s user 0.197s sys 0.012s Metrics: {"bytes_written":4777755,"cfile_cache_hit":11,"cfile_cache_hit_bytes":616588,"cfile_cache_miss":217,"cfile_cache_miss_bytes":11805470,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":171,"dirs.run_cpu_time_us":112,"dirs.run_wall_time_us":671,"drs_written":1,"lbm_read_time_us":7390,"lbm_reads_lt_1ms":237,"lbm_write_time_us":13742,"lbm_writes_1-10_ms":3,"lbm_writes_lt_1ms":217,"num_input_rowsets":2,"peak_mem_usage":2695245,"rows_written":170650}
I20260615 08:08:50.612867 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 1858341 bytes on disk
I20260615 08:08:50.612985 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20260615 08:08:50.613075 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:50.638747 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.026s user 0.016s sys 0.000s Metrics: {"bytes_written":303005,"cfile_init":1,"dirs.queue_time_us":21,"dirs.run_cpu_time_us":95,"dirs.run_wall_time_us":609,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":756,"lbm_writes_lt_1ms":33,"peak_mem_usage":0,"rows_written":10450}
I20260615 08:08:50.638901 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.012932
I20260615 08:08:50.640456 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.307s user 0.185s sys 0.020s Metrics: {"bytes_written":4799529,"cfile_cache_hit":13,"cfile_cache_hit_bytes":816773,"cfile_cache_miss":217,"cfile_cache_miss_bytes":11658057,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":458,"dirs.run_cpu_time_us":120,"dirs.run_wall_time_us":910,"drs_written":1,"lbm_read_time_us":7388,"lbm_reads_lt_1ms":237,"lbm_write_time_us":10532,"lbm_writes_lt_1ms":221,"num_input_rowsets":2,"peak_mem_usage":2706664,"rows_written":171350}
I20260615 08:08:50.641284 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 1866823 bytes on disk
I20260615 08:08:50.642951 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:08:50.643069 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:50.675318 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.032s user 0.016s sys 0.000s Metrics: {"bytes_written":315996,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":92,"dirs.run_wall_time_us":1431,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1064,"lbm_writes_lt_1ms":34,"peak_mem_usage":0,"rows_written":10950}
I20260615 08:08:50.675479 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.012780
I20260615 08:08:50.683842 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.369s user 0.197s sys 0.022s Metrics: {"bytes_written":4776491,"cfile_cache_hit":11,"cfile_cache_hit_bytes":616882,"cfile_cache_miss":217,"cfile_cache_miss_bytes":11802974,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":38,"dirs.run_cpu_time_us":111,"dirs.run_wall_time_us":569,"drs_written":1,"lbm_read_time_us":12634,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":240,"lbm_write_time_us":12549,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":219,"num_input_rowsets":2,"peak_mem_usage":2696080,"rows_written":170600}
I20260615 08:08:50.684345 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 1857870 bytes on disk
I20260615 08:08:50.684540 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20260615 08:08:50.684700 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:50.734336 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.050s user 0.019s sys 0.000s Metrics: {"bytes_written":391350,"cfile_init":1,"dirs.queue_time_us":1307,"dirs.run_cpu_time_us":92,"dirs.run_wall_time_us":462,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":872,"lbm_writes_lt_1ms":36,"peak_mem_usage":0,"rows_written":13650}
I20260615 08:08:50.734714 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1057021 bytes of WAL
I20260615 08:08:50.735764 14623 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:50.742676 14623 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000006 (ops 2923-3504)
I20260615 08:08:50.743580 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.008s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:50.743726 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.012903
I20260615 08:08:50.925032 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.286s user 0.193s sys 0.030s Metrics: {"bytes_written":5069625,"cfile_cache_hit":11,"cfile_cache_hit_bytes":494111,"cfile_cache_miss":229,"cfile_cache_miss_bytes":12693681,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":55,"dirs.run_cpu_time_us":119,"dirs.run_wall_time_us":1375,"drs_written":1,"lbm_read_time_us":7136,"lbm_reads_lt_1ms":253,"lbm_write_time_us":13473,"lbm_writes_lt_1ms":232,"num_input_rowsets":2,"peak_mem_usage":2862545,"rows_written":181100,"spinlock_wait_cycles":768}
I20260615 08:08:50.925318 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 1977869 bytes on disk
I20260615 08:08:50.925549 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20260615 08:08:50.925705 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:50.944993 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.019s user 0.016s sys 0.002s Metrics: {"bytes_written":378203,"cfile_init":1,"dirs.queue_time_us":27,"dirs.run_cpu_time_us":95,"dirs.run_wall_time_us":427,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":935,"lbm_writes_lt_1ms":36,"peak_mem_usage":0,"rows_written":13150}
I20260615 08:08:50.945235 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1053717 bytes of WAL
I20260615 08:08:50.945392 14547 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:50.945506 14547 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000006 (ops 3106-3715)
I20260615 08:08:50.945883 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:50.946025 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.012941
I20260615 08:08:51.075310 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.400s user 0.209s sys 0.008s Metrics: {"bytes_written":5102843,"cfile_cache_hit":14,"cfile_cache_hit_bytes":1022315,"cfile_cache_miss":228,"cfile_cache_miss_bytes":12253655,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":394,"dirs.run_cpu_time_us":90,"dirs.run_wall_time_us":370,"drs_written":1,"lbm_read_time_us":8969,"lbm_reads_lt_1ms":252,"lbm_write_time_us":12640,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":233,"num_input_rowsets":2,"peak_mem_usage":2881543,"rows_written":182300,"spinlock_wait_cycles":1664}
I20260615 08:08:51.075618 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:51.102213 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.026s user 0.013s sys 0.008s Metrics: {"bytes_written":469088,"cfile_init":1,"dirs.queue_time_us":47,"dirs.run_cpu_time_us":95,"dirs.run_wall_time_us":403,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1162,"lbm_writes_lt_1ms":40,"peak_mem_usage":0,"rows_written":16400}
I20260615 08:08:51.102473 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1052518 bytes of WAL
I20260615 08:08:51.102618 14698 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:51.102698 14698 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000006 (ops 3132-3741)
I20260615 08:08:51.103156 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:51.103304 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.012896
I20260615 08:08:51.112787 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.369s user 0.204s sys 0.022s Metrics: {"bytes_written":5155265,"cfile_cache_hit":10,"cfile_cache_hit_bytes":523120,"cfile_cache_miss":234,"cfile_cache_miss_bytes":12892718,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":29,"dirs.run_cpu_time_us":114,"dirs.run_wall_time_us":725,"drs_written":1,"lbm_read_time_us":12419,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":257,"lbm_write_time_us":29505,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":234,"num_input_rowsets":2,"peak_mem_usage":2912171,"rows_written":184250,"spinlock_wait_cycles":13419392}
I20260615 08:08:51.113170 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:51.157155 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.044s user 0.019s sys 0.003s Metrics: {"bytes_written":437462,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":89,"dirs.run_wall_time_us":859,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1246,"lbm_writes_lt_1ms":39,"peak_mem_usage":0,"rows_written":15300}
I20260615 08:08:51.158084 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 2157725 bytes on disk
I20260615 08:08:51.159111 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":812,"lbm_reads_lt_1ms":8}
I20260615 08:08:51.159472 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.012887
I20260615 08:08:51.183198 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.237s user 0.214s sys 0.014s Metrics: {"bytes_written":5436063,"cfile_cache_hit":12,"cfile_cache_hit_bytes":723635,"cfile_cache_miss":244,"cfile_cache_miss_bytes":13434925,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":200,"dirs.run_cpu_time_us":96,"dirs.run_wall_time_us":571,"drs_written":1,"lbm_read_time_us":6269,"lbm_reads_lt_1ms":268,"lbm_write_time_us":10987,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":247,"num_input_rowsets":2,"peak_mem_usage":3075161,"rows_written":194250,"spinlock_wait_cycles":397056}
I20260615 08:08:51.183403 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 2129626 bytes on disk
I20260615 08:08:51.183568 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:08:51.244408 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:51.262264 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.018s user 0.014s sys 0.000s Metrics: {"bytes_written":273654,"cfile_init":1,"dirs.queue_time_us":252,"dirs.run_cpu_time_us":99,"dirs.run_wall_time_us":516,"drs_written":1,"lbm_read_time_us":103,"lbm_reads_lt_1ms":4,"lbm_write_time_us":855,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9500}
I20260615 08:08:51.262537 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.012785
I20260615 08:08:51.343107 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.240s user 0.205s sys 0.028s Metrics: {"bytes_written":5559405,"cfile_cache_hit":13,"cfile_cache_hit_bytes":915841,"cfile_cache_miss":249,"cfile_cache_miss_bytes":13556603,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":306,"dirs.run_cpu_time_us":104,"dirs.run_wall_time_us":539,"drs_written":1,"lbm_read_time_us":5791,"lbm_reads_lt_1ms":277,"lbm_write_time_us":10665,"lbm_writes_lt_1ms":255,"num_input_rowsets":2,"peak_mem_usage":3145868,"rows_written":198700}
I20260615 08:08:51.343695 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 2181174 bytes on disk
I20260615 08:08:51.343888 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:08:51.404657 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:51.470382 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.065s user 0.012s sys 0.003s Metrics: {"bytes_written":271122,"cfile_init":1,"dirs.queue_time_us":174,"dirs.run_cpu_time_us":124,"dirs.run_wall_time_us":1209,"drs_written":1,"lbm_read_time_us":167,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3307,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"rows_written":9400}
I20260615 08:08:51.470584 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 86450 bytes on disk
I20260615 08:08:51.471930 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":26,"lbm_reads_lt_1ms":4}
I20260615 08:08:51.472283 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.012793
I20260615 08:08:51.539114 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.276s user 0.222s sys 0.013s Metrics: {"bytes_written":5701452,"cfile_cache_hit":11,"cfile_cache_hit_bytes":612139,"cfile_cache_miss":257,"cfile_cache_miss_bytes":14251221,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":148,"dirs.run_cpu_time_us":127,"dirs.run_wall_time_us":507,"drs_written":1,"lbm_read_time_us":6600,"lbm_reads_lt_1ms":281,"lbm_write_time_us":12589,"lbm_writes_lt_1ms":260,"mutex_wait_us":1,"num_input_rowsets":2,"peak_mem_usage":3233183,"rows_written":203750}
I20260615 08:08:51.539534 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 2238875 bytes on disk
I20260615 08:08:51.539789 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20260615 08:08:51.539978 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:51.555088 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.015s user 0.014s sys 0.000s Metrics: {"bytes_written":288201,"cfile_init":1,"dirs.queue_time_us":101,"dirs.run_cpu_time_us":72,"dirs.run_wall_time_us":940,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":655,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":10050}
I20260615 08:08:51.555313 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 92432 bytes on disk
I20260615 08:08:51.555481 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":21,"lbm_reads_lt_1ms":4}
I20260615 08:08:51.555614 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.012509
I20260615 08:08:51.618077 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.458s user 0.238s sys 0.017s Metrics: {"bytes_written":5581313,"cfile_cache_hit":13,"cfile_cache_hit_bytes":912500,"cfile_cache_miss":251,"cfile_cache_miss_bytes":13622944,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":88,"dirs.run_cpu_time_us":103,"dirs.run_wall_time_us":524,"drs_written":1,"lbm_read_time_us":8883,"lbm_reads_lt_1ms":271,"lbm_write_time_us":17608,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":253,"num_input_rowsets":2,"peak_mem_usage":3159127,"rows_written":199550,"spinlock_wait_cycles":768,"thread_start_us":106,"threads_started":3}
I20260615 08:08:51.618259 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 2190403 bytes on disk
I20260615 08:08:51.621574 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":28,"lbm_reads_lt_1ms":4}
I20260615 08:08:51.621716 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:51.667270 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.045s user 0.018s sys 0.004s Metrics: {"bytes_written":482976,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":110,"dirs.run_wall_time_us":545,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1098,"lbm_writes_lt_1ms":40,"peak_mem_usage":0,"rows_written":16950}
I20260615 08:08:51.667752 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1051609 bytes of WAL
I20260615 08:08:51.668494 14623 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:51.668543 14623 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000007 (ops 3505-4083)
I20260615 08:08:51.669045 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:51.669432 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.012727
I20260615 08:08:51.807121 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.251s user 0.228s sys 0.021s Metrics: {"bytes_written":5979312,"cfile_cache_hit":11,"cfile_cache_hit_bytes":485501,"cfile_cache_miss":269,"cfile_cache_miss_bytes":15116767,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":341,"dirs.run_cpu_time_us":119,"dirs.run_wall_time_us":678,"drs_written":1,"lbm_read_time_us":7433,"lbm_reads_lt_1ms":289,"lbm_write_time_us":12158,"lbm_writes_lt_1ms":272,"num_input_rowsets":2,"peak_mem_usage":3397584,"rows_written":213800,"spinlock_wait_cycles":1664}
I20260615 08:08:51.807300 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 2353628 bytes on disk
I20260615 08:08:51.807471 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:08:51.817732 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:51.843216 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.025s user 0.009s sys 0.006s Metrics: {"bytes_written":272553,"cfile_init":1,"dirs.queue_time_us":17,"dirs.run_cpu_time_us":99,"dirs.run_wall_time_us":500,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":700,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9450}
I20260615 08:08:51.843416 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1084373 bytes of WAL
I20260615 08:08:51.843539 14547 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:51.843600 14547 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000007 (ops 3716-4339)
I20260615 08:08:51.844125 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:51.844261 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 87781 bytes on disk
I20260615 08:08:51.844398 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":22,"lbm_reads_lt_1ms":4}
I20260615 08:08:51.844520 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.012585
I20260615 08:08:51.923543 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.451s user 0.230s sys 0.024s Metrics: {"bytes_written":5820879,"cfile_cache_hit":16,"cfile_cache_hit_bytes":1314685,"cfile_cache_miss":260,"cfile_cache_miss_bytes":13866693,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":194,"dirs.run_cpu_time_us":111,"dirs.run_wall_time_us":774,"drs_written":1,"lbm_read_time_us":9069,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":279,"lbm_write_time_us":35167,"lbm_writes_1-10_ms":2,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":263,"num_input_rowsets":2,"peak_mem_usage":3305616,"rows_written":208100,"spinlock_wait_cycles":768,"thread_start_us":193,"threads_started":5}
I20260615 08:08:51.924067 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:51.950663 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.026s user 0.019s sys 0.004s Metrics: {"bytes_written":500837,"cfile_init":1,"dirs.queue_time_us":19,"dirs.run_cpu_time_us":97,"dirs.run_wall_time_us":470,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1269,"lbm_writes_lt_1ms":42,"peak_mem_usage":0,"rows_written":17500}
I20260615 08:08:51.950953 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1055341 bytes of WAL
I20260615 08:08:51.951148 14698 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:51.951231 14698 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000007 (ops 3742-4345)
I20260615 08:08:51.951670 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:51.952184 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.012611
I20260615 08:08:51.976997 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.307s user 0.232s sys 0.024s Metrics: {"bytes_written":6052999,"cfile_cache_hit":11,"cfile_cache_hit_bytes":578305,"cfile_cache_miss":273,"cfile_cache_miss_bytes":15202649,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":32,"dirs.run_cpu_time_us":74,"dirs.run_wall_time_us":388,"drs_written":1,"lbm_read_time_us":8785,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":296,"lbm_write_time_us":11942,"lbm_writes_lt_1ms":275,"num_input_rowsets":2,"peak_mem_usage":3431250,"rows_written":216500,"spinlock_wait_cycles":384}
I20260615 08:08:51.979598 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 2384865 bytes on disk
I20260615 08:08:51.980427 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20260615 08:08:51.980683 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:51.998190 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.017s user 0.014s sys 0.000s Metrics: {"bytes_written":288228,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":72,"dirs.run_wall_time_us":466,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":591,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":10050}
I20260615 08:08:51.998400 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 94434 bytes on disk
I20260615 08:08:51.998600 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:08:51.998780 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.012551
I20260615 08:08:52.219164 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.267s user 0.227s sys 0.034s Metrics: {"bytes_written":6302537,"cfile_cache_hit":12,"cfile_cache_hit_bytes":748397,"cfile_cache_miss":286,"cfile_cache_miss_bytes":15708919,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":511,"dirs.run_cpu_time_us":121,"dirs.run_wall_time_us":626,"drs_written":1,"lbm_read_time_us":6464,"lbm_reads_lt_1ms":314,"lbm_write_time_us":11073,"lbm_writes_lt_1ms":285,"num_input_rowsets":2,"peak_mem_usage":3585158,"rows_written":225600}
I20260615 08:08:52.219450 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 2489952 bytes on disk
I20260615 08:08:52.219628 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:08:52.263991 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.265s user 0.236s sys 0.016s Metrics: {"bytes_written":6331930,"cfile_cache_hit":11,"cfile_cache_hit_bytes":485706,"cfile_cache_miss":285,"cfile_cache_miss_bytes":16058050,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":20,"dirs.run_cpu_time_us":67,"dirs.run_wall_time_us":355,"drs_written":1,"lbm_read_time_us":6721,"lbm_reads_lt_1ms":305,"lbm_write_time_us":10886,"lbm_writes_lt_1ms":287,"num_input_rowsets":2,"peak_mem_usage":3606402,"rows_written":226550}
I20260615 08:08:52.264206 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 2501142 bytes on disk
I20260615 08:08:52.264813 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:08:52.268888 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.424s user 0.266s sys 0.012s Metrics: {"bytes_written":6240756,"cfile_cache_hit":11,"cfile_cache_hit_bytes":472337,"cfile_cache_miss":281,"cfile_cache_miss_bytes":15825141,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":1101,"dirs.run_cpu_time_us":149,"dirs.run_wall_time_us":629,"drs_written":1,"lbm_read_time_us":12320,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":300,"lbm_write_time_us":22710,"lbm_writes_1-10_ms":3,"lbm_writes_lt_1ms":280,"num_input_rowsets":2,"peak_mem_usage":3553384,"rows_written":223250,"spinlock_wait_cycles":4218752}
I20260615 08:08:52.269189 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 2462065 bytes on disk
I20260615 08:08:52.269500 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:08:52.280736 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:52.299758 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.019s user 0.016s sys 0.000s Metrics: {"bytes_written":321349,"cfile_init":1,"dirs.queue_time_us":20,"dirs.run_cpu_time_us":88,"dirs.run_wall_time_us":482,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":797,"lbm_writes_lt_1ms":34,"peak_mem_usage":0,"rows_written":11150}
I20260615 08:08:52.300022 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 103373 bytes on disk
I20260615 08:08:52.300292 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":22,"lbm_reads_lt_1ms":4}
I20260615 08:08:52.300510 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.012436
I20260615 08:08:52.301010 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:52.315582 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:52.331225 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.030s user 0.013s sys 0.000s Metrics: {"bytes_written":280374,"cfile_init":1,"dirs.queue_time_us":26,"dirs.run_cpu_time_us":116,"dirs.run_wall_time_us":662,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3107,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"rows_written":9750}
I20260615 08:08:52.331517 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.012323
I20260615 08:08:52.361433 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.046s user 0.015s sys 0.000s Metrics: {"bytes_written":275108,"cfile_init":1,"dirs.queue_time_us":23,"dirs.run_cpu_time_us":96,"dirs.run_wall_time_us":472,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1185,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9550}
I20260615 08:08:52.361634 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1056899 bytes of WAL
I20260615 08:08:52.361737 14623 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:52.362200 14623 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000008 (ops 4084-4665)
I20260615 08:08:52.363487 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.002s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:52.363622 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.012314
I20260615 08:08:52.588234 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.288s user 0.267s sys 0.016s Metrics: {"bytes_written":6553459,"cfile_cache_hit":11,"cfile_cache_hit_bytes":510258,"cfile_cache_miss":295,"cfile_cache_miss_bytes":16606328,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":715,"dirs.run_cpu_time_us":108,"dirs.run_wall_time_us":799,"drs_written":1,"lbm_read_time_us":7887,"lbm_reads_lt_1ms":315,"lbm_write_time_us":13951,"lbm_writes_lt_1ms":296,"num_input_rowsets":2,"peak_mem_usage":3731207,"rows_written":234400,"spinlock_wait_cycles":1152}
I20260615 08:08:52.591503 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 2590871 bytes on disk
I20260615 08:08:52.592581 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20260615 08:08:52.602905 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:52.626206 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.295s user 0.265s sys 0.012s Metrics: {"bytes_written":6577580,"cfile_cache_hit":11,"cfile_cache_hit_bytes":479205,"cfile_cache_miss":295,"cfile_cache_miss_bytes":16707685,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":154,"dirs.run_cpu_time_us":488,"dirs.run_wall_time_us":3059,"drs_written":1,"lbm_read_time_us":7893,"lbm_reads_lt_1ms":319,"lbm_write_time_us":13108,"lbm_writes_lt_1ms":297,"num_input_rowsets":2,"peak_mem_usage":3749693,"rows_written":235350}
I20260615 08:08:52.626474 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 2602006 bytes on disk
I20260615 08:08:52.628413 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4}
I20260615 08:08:52.628865 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:52.632568 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.029s user 0.015s sys 0.000s Metrics: {"bytes_written":279157,"cfile_init":1,"dirs.queue_time_us":42,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1505,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9700}
I20260615 08:08:52.633066 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.012386
I20260615 08:08:52.649108 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.020s user 0.014s sys 0.000s Metrics: {"bytes_written":280434,"cfile_init":1,"dirs.queue_time_us":481,"dirs.run_cpu_time_us":77,"dirs.run_wall_time_us":2139,"drs_written":1,"lbm_read_time_us":12,"lbm_reads_lt_1ms":4,"lbm_write_time_us":632,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9750}
I20260615 08:08:52.649631 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.012260
I20260615 08:08:52.879856 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.516s user 0.257s sys 0.022s Metrics: {"bytes_written":6600516,"cfile_cache_hit":13,"cfile_cache_hit_bytes":809435,"cfile_cache_miss":295,"cfile_cache_miss_bytes":16436055,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":42,"dirs.run_cpu_time_us":144,"dirs.run_wall_time_us":735,"drs_written":1,"lbm_read_time_us":9628,"lbm_reads_lt_1ms":319,"lbm_write_time_us":23108,"lbm_writes_1-10_ms":3,"lbm_writes_lt_1ms":295,"num_input_rowsets":2,"peak_mem_usage":3760432,"rows_written":236100,"spinlock_wait_cycles":905472,"thread_start_us":1544,"threads_started":5}
I20260615 08:08:52.880102 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 2610477 bytes on disk
I20260615 08:08:52.881764 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:08:52.881948 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.937278
I20260615 08:08:52.935050 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.053s user 0.022s sys 0.004s Metrics: {"bytes_written":572322,"cfile_init":1,"dirs.queue_time_us":20,"dirs.run_cpu_time_us":105,"dirs.run_wall_time_us":610,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1762,"lbm_writes_lt_1ms":44,"peak_mem_usage":0,"rows_written":20100}
I20260615 08:08:52.935312 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 193062 bytes on disk
I20260615 08:08:52.935496 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":30,"lbm_reads_lt_1ms":4}
I20260615 08:08:52.935649 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.012195
I20260615 08:08:53.071178 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.437s user 0.281s sys 0.008s Metrics: {"bytes_written":6818840,"cfile_cache_hit":12,"cfile_cache_hit_bytes":781662,"cfile_cache_miss":304,"cfile_cache_miss_bytes":17055936,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":74,"dirs.run_cpu_time_us":118,"dirs.run_wall_time_us":656,"drs_written":1,"lbm_read_time_us":10635,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":327,"lbm_write_time_us":15795,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":305,"mutex_wait_us":2,"num_input_rowsets":2,"peak_mem_usage":3893573,"rows_written":244100,"spinlock_wait_cycles":1792}
I20260615 08:08:53.071513 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 2703313 bytes on disk
I20260615 08:08:53.071713 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20260615 08:08:53.071907 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:53.074955 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.425s user 0.273s sys 0.020s Metrics: {"bytes_written":6848734,"cfile_cache_hit":11,"cfile_cache_hit_bytes":479382,"cfile_cache_miss":307,"cfile_cache_miss_bytes":17432050,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":591,"dirs.run_cpu_time_us":101,"dirs.run_wall_time_us":530,"drs_written":1,"lbm_read_time_us":11551,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":329,"lbm_write_time_us":17246,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":306,"num_input_rowsets":2,"peak_mem_usage":3906473,"rows_written":245100,"spinlock_wait_cycles":4358912}
I20260615 08:08:53.075196 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:53.097524 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.025s user 0.014s sys 0.007s Metrics: {"bytes_written":505807,"cfile_init":1,"dirs.queue_time_us":34,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1067,"lbm_writes_lt_1ms":42,"peak_mem_usage":0,"rows_written":17700}
I20260615 08:08:53.097756 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1065848 bytes of WAL
I20260615 08:08:53.097913 14547 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:53.097982 14547 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000008 (ops 4340-4958)
I20260615 08:08:53.098515 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:53.098680 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.012134
I20260615 08:08:53.104943 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.030s user 0.017s sys 0.006s Metrics: {"bytes_written":476699,"cfile_init":1,"dirs.queue_time_us":24,"dirs.run_cpu_time_us":69,"dirs.run_wall_time_us":1626,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1464,"lbm_writes_lt_1ms":40,"peak_mem_usage":0,"rows_written":16700}
I20260615 08:08:53.105132 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1073479 bytes of WAL
I20260615 08:08:53.105278 14698 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:53.105329 14698 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000008 (ops 4346-4953)
I20260615 08:08:53.105772 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:53.105901 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.012133
I20260615 08:08:53.420957 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.322s user 0.275s sys 0.027s Metrics: {"bytes_written":7313485,"cfile_cache_hit":11,"cfile_cache_hit_bytes":693867,"cfile_cache_miss":325,"cfile_cache_miss_bytes":18432489,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":426,"dirs.run_cpu_time_us":111,"dirs.run_wall_time_us":707,"drs_written":1,"lbm_read_time_us":8756,"lbm_reads_lt_1ms":349,"lbm_write_time_us":14119,"lbm_writes_lt_1ms":327,"num_input_rowsets":2,"peak_mem_usage":4173171,"rows_written":261800,"spinlock_wait_cycles":1243520}
I20260615 08:08:53.421561 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 2906817 bytes on disk
I20260615 08:08:53.421767 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:08:53.453641 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:53.475075 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.021s user 0.015s sys 0.000s Metrics: {"bytes_written":277648,"cfile_init":1,"dirs.queue_time_us":16,"dirs.run_cpu_time_us":105,"dirs.run_wall_time_us":472,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":747,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9650}
I20260615 08:08:53.475910 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.011977
I20260615 08:08:53.514729 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.409s user 0.279s sys 0.027s Metrics: {"bytes_written":7313485,"cfile_cache_hit":15,"cfile_cache_hit_bytes":1157193,"cfile_cache_miss":321,"cfile_cache_miss_bytes":17973351,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":354,"dirs.run_cpu_time_us":1137,"dirs.run_wall_time_us":8010,"drs_written":1,"lbm_read_time_us":11324,"lbm_reads_lt_1ms":349,"lbm_write_time_us":16626,"lbm_writes_lt_1ms":327,"num_input_rowsets":2,"peak_mem_usage":4174172,"rows_written":261800,"spinlock_wait_cycles":1911296}
I20260615 08:08:53.515417 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:53.517792 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.582s user 0.297s sys 0.027s Metrics: {"bytes_written":7153668,"cfile_cache_hit":13,"cfile_cache_hit_bytes":920610,"cfile_cache_miss":317,"cfile_cache_miss_bytes":17786544,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":19,"dirs.run_cpu_time_us":116,"dirs.run_wall_time_us":611,"drs_written":1,"lbm_read_time_us":18134,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":335,"lbm_write_time_us":25140,"lbm_writes_1-10_ms":3,"lbm_writes_lt_1ms":317,"num_input_rowsets":2,"peak_mem_usage":4079773,"rows_written":256200}
I20260615 08:08:53.518100 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:53.550328 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.034s user 0.018s sys 0.000s Metrics: {"bytes_written":351843,"cfile_init":1,"dirs.queue_time_us":19,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":789,"lbm_writes_lt_1ms":35,"peak_mem_usage":0,"rows_written":12150,"spinlock_wait_cycles":896}
I20260615 08:08:53.550515 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 3019796 bytes on disk
I20260615 08:08:53.550688 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":38,"lbm_reads_lt_1ms":8}
I20260615 08:08:53.550799 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.011961
I20260615 08:08:53.558295 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.040s user 0.021s sys 0.004s Metrics: {"bytes_written":509601,"cfile_init":1,"dirs.queue_time_us":1588,"dirs.run_cpu_time_us":82,"dirs.run_wall_time_us":924,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2131,"lbm_writes_lt_1ms":42,"peak_mem_usage":0,"rows_written":17850}
I20260615 08:08:53.558624 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 3011145 bytes on disk
I20260615 08:08:53.558876 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":38,"lbm_reads_lt_1ms":8}
I20260615 08:08:53.559113 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1049847 bytes of WAL
I20260615 08:08:53.559252 14623 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:53.559520 14623 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000009 (ops 4666-5243)
I20260615 08:08:53.560006 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:53.560155 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.012053
I20260615 08:08:53.893211 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.333s user 0.293s sys 0.025s Metrics: {"bytes_written":7652887,"cfile_cache_hit":12,"cfile_cache_hit_bytes":859606,"cfile_cache_miss":338,"cfile_cache_miss_bytes":19161248,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":168,"dirs.run_cpu_time_us":114,"dirs.run_wall_time_us":998,"drs_written":1,"lbm_read_time_us":11302,"lbm_reads_lt_1ms":358,"lbm_write_time_us":15322,"lbm_writes_lt_1ms":343,"num_input_rowsets":2,"peak_mem_usage":4370420,"rows_written":274050,"spinlock_wait_cycles":2304}
I20260615 08:08:53.893530 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:53.912720 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.019s user 0.014s sys 0.003s Metrics: {"bytes_written":349034,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":94,"dirs.run_wall_time_us":411,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":851,"lbm_writes_lt_1ms":35,"peak_mem_usage":0,"rows_written":12050}
I20260615 08:08:53.912998 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 3161807 bytes on disk
I20260615 08:08:53.913249 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":38,"lbm_reads_lt_1ms":8}
I20260615 08:08:53.913432 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.011651
I20260615 08:08:53.958457 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.482s user 0.286s sys 0.036s Metrics: {"bytes_written":7577270,"cfile_cache_hit":12,"cfile_cache_hit_bytes":643055,"cfile_cache_miss":334,"cfile_cache_miss_bytes":19210743,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":196,"dirs.run_cpu_time_us":105,"dirs.run_wall_time_us":14740,"drs_written":1,"lbm_read_time_us":9485,"lbm_reads_lt_1ms":358,"lbm_write_time_us":23941,"lbm_writes_1-10_ms":3,"lbm_writes_lt_1ms":337,"num_input_rowsets":2,"peak_mem_usage":4336380,"rows_written":271450,"thread_start_us":201,"threads_started":5}
I20260615 08:08:53.958788 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 3019128 bytes on disk
I20260615 08:08:53.959125 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20260615 08:08:53.959321 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:53.986641 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.027s user 0.019s sys 0.004s Metrics: {"bytes_written":475290,"cfile_init":1,"dirs.queue_time_us":153,"dirs.run_cpu_time_us":82,"dirs.run_wall_time_us":424,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1052,"lbm_writes_lt_1ms":40,"peak_mem_usage":0,"rows_written":16650,"spinlock_wait_cycles":384}
I20260615 08:08:53.986918 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1057606 bytes of WAL
I20260615 08:08:53.987017 14547 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:53.987107 14547 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000009 (ops 4959-5564)
I20260615 08:08:53.987533 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:53.987653 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 158711 bytes on disk
I20260615 08:08:53.987833 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":22,"lbm_reads_lt_1ms":4}
I20260615 08:08:53.988001 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.011775
I20260615 08:08:54.196211 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.645s user 0.287s sys 0.036s Metrics: {"bytes_written":7649776,"cfile_cache_hit":12,"cfile_cache_hit_bytes":698545,"cfile_cache_miss":336,"cfile_cache_miss_bytes":19335495,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":129,"dirs.run_cpu_time_us":110,"dirs.run_wall_time_us":623,"drs_written":1,"lbm_read_time_us":19977,"lbm_reads_1-10_ms":4,"lbm_reads_lt_1ms":352,"lbm_write_time_us":18713,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":342,"num_input_rowsets":2,"peak_mem_usage":4374503,"rows_written":273950,"spinlock_wait_cycles":8291328,"thread_start_us":245,"threads_started":5}
I20260615 08:08:54.202824 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 3048484 bytes on disk
I20260615 08:08:54.203027 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:08:54.203275 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.937278
I20260615 08:08:54.324836 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.121s user 0.021s sys 0.008s Metrics: {"bytes_written":653436,"cfile_init":1,"dirs.queue_time_us":43,"dirs.run_cpu_time_us":116,"dirs.run_wall_time_us":559,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":5332,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":46,"peak_mem_usage":0,"rows_written":22900}
I20260615 08:08:54.325021 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1059869 bytes of WAL
I20260615 08:08:54.325397 14698 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:54.325987 14698 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000009 (ops 4954-5569)
I20260615 08:08:54.326467 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:54.326676 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.011679
I20260615 08:08:54.351225 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.363s user 0.315s sys 0.024s Metrics: {"bytes_written":8041444,"cfile_cache_hit":15,"cfile_cache_hit_bytes":1238845,"cfile_cache_miss":355,"cfile_cache_miss_bytes":19828029,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":222,"dirs.run_cpu_time_us":112,"dirs.run_wall_time_us":683,"drs_written":1,"lbm_read_time_us":9596,"lbm_reads_lt_1ms":375,"lbm_write_time_us":18532,"lbm_writes_lt_1ms":359,"num_input_rowsets":2,"peak_mem_usage":4598269,"rows_written":288100}
I20260615 08:08:54.351527 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:54.377818 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.026s user 0.020s sys 0.000s Metrics: {"bytes_written":407083,"cfile_init":1,"dirs.queue_time_us":24,"dirs.run_cpu_time_us":100,"dirs.run_wall_time_us":730,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2307,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":37,"peak_mem_usage":0,"rows_written":14100,"spinlock_wait_cycles":2310016}
I20260615 08:08:54.378100 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 3342609 bytes on disk
I20260615 08:08:54.378335 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":36,"lbm_reads_lt_1ms":8}
I20260615 08:08:54.378539 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.011667
I20260615 08:08:54.417008 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.503s user 0.328s sys 0.012s Metrics: {"bytes_written":7986819,"cfile_cache_hit":14,"cfile_cache_hit_bytes":1026381,"cfile_cache_miss":352,"cfile_cache_miss_bytes":19907171,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":82,"dirs.run_cpu_time_us":95,"dirs.run_wall_time_us":716,"drs_written":1,"lbm_read_time_us":10470,"lbm_reads_lt_1ms":372,"lbm_write_time_us":26344,"lbm_writes_1-10_ms":4,"lbm_writes_lt_1ms":353,"num_input_rowsets":2,"peak_mem_usage":4568727,"rows_written":286100,"spinlock_wait_cycles":121728,"thread_start_us":207,"threads_started":5}
I20260615 08:08:54.417349 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:54.448936 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.031s user 0.021s sys 0.000s Metrics: {"bytes_written":493175,"cfile_init":1,"dirs.queue_time_us":53,"dirs.run_cpu_time_us":82,"dirs.run_wall_time_us":476,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1130,"lbm_writes_lt_1ms":41,"peak_mem_usage":0,"rows_written":17200}
I20260615 08:08:54.449246 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1078681 bytes of WAL
I20260615 08:08:54.449499 14623 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:54.449545 14623 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000010 (ops 5244-5837)
I20260615 08:08:54.449951 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:54.450223 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.011770
I20260615 08:08:54.720140 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.393s user 0.334s sys 0.015s Metrics: {"bytes_written":8282417,"cfile_cache_hit":16,"cfile_cache_hit_bytes":1518696,"cfile_cache_miss":362,"cfile_cache_miss_bytes":20187840,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":7796,"dirs.run_cpu_time_us":122,"dirs.run_wall_time_us":664,"drs_written":1,"lbm_read_time_us":10565,"lbm_reads_lt_1ms":386,"lbm_write_time_us":15864,"lbm_writes_lt_1ms":370,"num_input_rowsets":2,"peak_mem_usage":4735842,"rows_written":296850,"spinlock_wait_cycles":768,"thread_start_us":117,"threads_started":3}
I20260615 08:08:54.721203 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:54.743561 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.022s user 0.018s sys 0.000s Metrics: {"bytes_written":369293,"cfile_init":1,"dirs.queue_time_us":27,"dirs.run_cpu_time_us":94,"dirs.run_wall_time_us":1516,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":892,"lbm_writes_lt_1ms":35,"peak_mem_usage":0,"rows_written":12800}
I20260615 08:08:54.743844 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1050506 bytes of WAL
I20260615 08:08:54.744035 14698 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:54.744124 14698 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000010 (ops 5570-6182)
I20260615 08:08:54.744581 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:54.744803 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.011682
I20260615 08:08:54.763306 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.385s user 0.338s sys 0.027s Metrics: {"bytes_written":8431735,"cfile_cache_hit":11,"cfile_cache_hit_bytes":571052,"cfile_cache_miss":375,"cfile_cache_miss_bytes":21543182,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":121,"dirs.run_cpu_time_us":109,"dirs.run_wall_time_us":615,"drs_written":1,"lbm_read_time_us":11259,"lbm_reads_lt_1ms":395,"lbm_write_time_us":17317,"lbm_writes_lt_1ms":375,"num_input_rowsets":2,"peak_mem_usage":4833233,"rows_written":302200,"spinlock_wait_cycles":1102208}
I20260615 08:08:54.763679 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 3374029 bytes on disk
I20260615 08:08:54.763856 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20260615 08:08:54.784260 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:54.831804 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.047s user 0.014s sys 0.000s Metrics: {"bytes_written":276420,"cfile_init":1,"dirs.queue_time_us":172,"dirs.run_cpu_time_us":102,"dirs.run_wall_time_us":1622,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1109,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9600}
I20260615 08:08:54.833326 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1055467 bytes of WAL
I20260615 08:08:54.835151 14547 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:54.835265 14547 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000010 (ops 5565-6172)
I20260615 08:08:54.837590 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.002s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:54.837788 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.011657
I20260615 08:08:55.074738 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.624s user 0.333s sys 0.027s Metrics: {"bytes_written":8463720,"cfile_cache_hit":17,"cfile_cache_hit_bytes":1359903,"cfile_cache_miss":369,"cfile_cache_miss_bytes":20823491,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":51,"dirs.run_cpu_time_us":106,"dirs.run_wall_time_us":590,"drs_written":1,"lbm_read_time_us":30363,"lbm_reads_1-10_ms":5,"lbm_reads_lt_1ms":392,"lbm_write_time_us":22331,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":376,"num_input_rowsets":2,"peak_mem_usage":4848002,"rows_written":303300,"spinlock_wait_cycles":8419840,"thread_start_us":271,"threads_started":5}
I20260615 08:08:55.075090 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 3387008 bytes on disk
I20260615 08:08:55.075461 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20260615 08:08:55.075671 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.937278
I20260615 08:08:55.118584 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.043s user 0.023s sys 0.007s Metrics: {"bytes_written":666519,"cfile_init":1,"dirs.queue_time_us":19,"dirs.run_cpu_time_us":89,"dirs.run_wall_time_us":533,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1453,"lbm_writes_lt_1ms":47,"peak_mem_usage":0,"rows_written":23400}
I20260615 08:08:55.118880 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1095220 bytes of WAL
I20260615 08:08:55.119046 14623 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:55.119108 14623 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000011 (ops 5838-6440)
I20260615 08:08:55.119503 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:55.119663 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 227621 bytes on disk
I20260615 08:08:55.119935 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:08:55.120086 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.011453
I20260615 08:08:55.205672 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.461s user 0.358s sys 0.010s Metrics: {"bytes_written":8639176,"cfile_cache_hit":11,"cfile_cache_hit_bytes":547765,"cfile_cache_miss":383,"cfile_cache_miss_bytes":22117487,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":24,"dirs.run_cpu_time_us":91,"dirs.run_wall_time_us":441,"drs_written":1,"lbm_read_time_us":12059,"lbm_reads_lt_1ms":411,"lbm_write_time_us":24689,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":384,"num_input_rowsets":2,"peak_mem_usage":4953935,"rows_written":309650,"spinlock_wait_cycles":1536}
I20260615 08:08:55.206221 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 3459884 bytes on disk
I20260615 08:08:55.207285 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4}
I20260615 08:08:55.207686 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.937278
I20260615 08:08:55.243193 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.035s user 0.025s sys 0.000s Metrics: {"bytes_written":560812,"cfile_init":1,"dirs.queue_time_us":14,"dirs.run_cpu_time_us":96,"dirs.run_wall_time_us":530,"drs_written":1,"lbm_read_time_us":53,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1674,"lbm_writes_lt_1ms":44,"peak_mem_usage":0,"rows_written":19650}
I20260615 08:08:55.243429 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 189666 bytes on disk
I20260615 08:08:55.243624 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":22,"lbm_reads_lt_1ms":4}
I20260615 08:08:55.244160 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.011385
I20260615 08:08:55.493073 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.655s user 0.336s sys 0.037s Metrics: {"bytes_written":8697674,"cfile_cache_hit":12,"cfile_cache_hit_bytes":640733,"cfile_cache_miss":384,"cfile_cache_miss_bytes":22191383,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":11905,"dirs.run_cpu_time_us":123,"dirs.run_wall_time_us":1711,"drs_written":1,"lbm_read_time_us":17183,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":406,"lbm_write_time_us":27285,"lbm_writes_1-10_ms":3,"lbm_writes_lt_1ms":384,"num_input_rowsets":2,"peak_mem_usage":4993725,"rows_written":311800,"spinlock_wait_cycles":792320,"thread_start_us":316,"threads_started":6}
I20260615 08:08:55.493427 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 3484599 bytes on disk
I20260615 08:08:55.493677 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:08:55.493927 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.937278
I20260615 08:08:55.531212 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.037s user 0.034s sys 0.000s Metrics: {"bytes_written":792127,"cfile_init":1,"dirs.queue_time_us":1933,"dirs.run_cpu_time_us":71,"dirs.run_wall_time_us":346,"drs_written":1,"lbm_read_time_us":467,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1701,"lbm_writes_lt_1ms":53,"peak_mem_usage":0,"rows_written":27750}
I20260615 08:08:55.531495 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.011377
I20260615 08:08:55.605751 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.485s user 0.353s sys 0.030s Metrics: {"bytes_written":9111854,"cfile_cache_hit":12,"cfile_cache_hit_bytes":761678,"cfile_cache_miss":400,"cfile_cache_miss_bytes":23144670,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":54,"dirs.run_cpu_time_us":84,"dirs.run_wall_time_us":405,"drs_written":1,"lbm_read_time_us":12573,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":419,"lbm_write_time_us":19158,"lbm_writes_lt_1ms":404,"num_input_rowsets":2,"peak_mem_usage":5222022,"rows_written":326700,"spinlock_wait_cycles":384,"thread_start_us":234,"threads_started":5}
I20260615 08:08:55.606454 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:55.635804 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.029s user 0.020s sys 0.000s Metrics: {"bytes_written":434645,"cfile_init":1,"dirs.queue_time_us":26,"dirs.run_cpu_time_us":72,"dirs.run_wall_time_us":3535,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":956,"lbm_writes_lt_1ms":38,"peak_mem_usage":0,"rows_written":15200}
I20260615 08:08:55.636155 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.011297
I20260615 08:08:55.796779 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.552s user 0.351s sys 0.035s Metrics: {"bytes_written":9182538,"cfile_cache_hit":12,"cfile_cache_hit_bytes":751125,"cfile_cache_miss":406,"cfile_cache_miss_bytes":23348085,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":246,"dirs.run_cpu_time_us":122,"dirs.run_wall_time_us":704,"drs_written":1,"lbm_read_time_us":16156,"lbm_reads_lt_1ms":426,"lbm_write_time_us":24643,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":407,"num_input_rowsets":2,"peak_mem_usage":5264716,"rows_written":329300,"spinlock_wait_cycles":1664,"thread_start_us":457,"threads_started":5}
I20260615 08:08:55.797722 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 3686787 bytes on disk
I20260615 08:08:55.798111 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20260615 08:08:55.798295 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:55.836781 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.038s user 0.019s sys 0.004s Metrics: {"bytes_written":480449,"cfile_init":1,"dirs.queue_time_us":27,"dirs.run_cpu_time_us":99,"dirs.run_wall_time_us":455,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1016,"lbm_writes_lt_1ms":40,"peak_mem_usage":0,"rows_written":16850}
I20260615 08:08:55.837059 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1057081 bytes of WAL
I20260615 08:08:55.837401 14698 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:55.837476 14698 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000011 (ops 6183-6813)
I20260615 08:08:55.838232 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:55.838369 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.011254
I20260615 08:08:55.996783 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.465s user 0.373s sys 0.040s Metrics: {"bytes_written":9465912,"cfile_cache_hit":12,"cfile_cache_hit_bytes":773630,"cfile_cache_miss":416,"cfile_cache_miss_bytes":24066880,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":208,"dirs.run_cpu_time_us":806,"dirs.run_wall_time_us":3769,"drs_written":1,"lbm_read_time_us":12905,"lbm_reads_lt_1ms":440,"lbm_write_time_us":21313,"lbm_writes_lt_1ms":421,"num_input_rowsets":2,"peak_mem_usage":5424814,"rows_written":339550}
I20260615 08:08:55.997151 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:56.015430 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.018s user 0.015s sys 0.000s Metrics: {"bytes_written":313549,"cfile_init":1,"dirs.queue_time_us":26,"dirs.run_cpu_time_us":89,"dirs.run_wall_time_us":2518,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":869,"lbm_writes_lt_1ms":33,"peak_mem_usage":0,"rows_written":10850}
I20260615 08:08:56.015995 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1049944 bytes of WAL
I20260615 08:08:56.016096 14547 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:56.016145 14547 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000011 (ops 6173-6795)
I20260615 08:08:56.016649 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:56.018438 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 3905118 bytes on disk
I20260615 08:08:56.018755 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":87,"lbm_reads_lt_1ms":8}
I20260615 08:08:56.018930 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.011098
I20260615 08:08:56.129451 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.493s user 0.366s sys 0.030s Metrics: {"bytes_written":9530082,"cfile_cache_hit":11,"cfile_cache_hit_bytes":574589,"cfile_cache_miss":419,"cfile_cache_miss_bytes":24458459,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":27,"dirs.run_cpu_time_us":109,"dirs.run_wall_time_us":508,"drs_written":1,"lbm_read_time_us":12350,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":446,"lbm_write_time_us":24667,"lbm_writes_1-10_ms":3,"lbm_writes_lt_1ms":420,"num_input_rowsets":2,"peak_mem_usage":5477214,"rows_written":341900,"spinlock_wait_cycles":768}
I20260615 08:08:56.129793 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 3832599 bytes on disk
I20260615 08:08:56.130041 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:08:56.130712 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:56.155627 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.024s user 0.013s sys 0.004s Metrics: {"bytes_written":334311,"cfile_init":1,"dirs.queue_time_us":31,"dirs.run_cpu_time_us":86,"dirs.run_wall_time_us":2475,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":774,"lbm_writes_lt_1ms":34,"peak_mem_usage":0,"rows_written":11650}
I20260615 08:08:56.155905 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 109898 bytes on disk
I20260615 08:08:56.158433 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:08:56.158660 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1062670 bytes of WAL
I20260615 08:08:56.158758 14623 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:56.158833 14623 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000012 (ops 6441-7025)
I20260615 08:08:56.159303 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:56.159448 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.011226
I20260615 08:08:56.361927 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.523s user 0.373s sys 0.029s Metrics: {"bytes_written":9650526,"cfile_cache_hit":14,"cfile_cache_hit_bytes":1180988,"cfile_cache_miss":426,"cfile_cache_miss_bytes":24162060,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":55,"dirs.run_cpu_time_us":117,"dirs.run_wall_time_us":671,"drs_written":1,"lbm_read_time_us":14007,"lbm_reads_lt_1ms":450,"lbm_write_time_us":27504,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":428,"num_input_rowsets":2,"peak_mem_usage":5542965,"rows_written":346150,"spinlock_wait_cycles":4480,"thread_start_us":205,"threads_started":5}
I20260615 08:08:56.362265 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:56.384061 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.022s user 0.016s sys 0.000s Metrics: {"bytes_written":358529,"cfile_init":1,"dirs.queue_time_us":23,"drs_written":1,"lbm_read_time_us":22,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1497,"lbm_writes_lt_1ms":35,"peak_mem_usage":0,"rows_written":12400}
I20260615 08:08:56.384342 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.011044
I20260615 08:08:56.384912 4267 test_workload.cc:405] TestWorkload: Skipping table creation because table test-workload already exists
I20260615 08:08:56.498232 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.479s user 0.371s sys 0.040s Metrics: {"bytes_written":9763530,"cfile_cache_hit":10,"cfile_cache_hit_bytes":471267,"cfile_cache_miss":434,"cfile_cache_miss_bytes":25199155,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":462,"dirs.run_cpu_time_us":103,"dirs.run_wall_time_us":14462,"drs_written":1,"lbm_read_time_us":14873,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":453,"lbm_write_time_us":20852,"lbm_writes_lt_1ms":433,"num_input_rowsets":2,"peak_mem_usage":5614731,"rows_written":350400,"spinlock_wait_cycles":1664,"thread_start_us":1142,"threads_started":1}
I20260615 08:08:56.500635 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 3930017 bytes on disk
I20260615 08:08:56.500790 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:08:56.500964 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:56.531255 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.030s user 0.018s sys 0.000s Metrics: {"bytes_written":355956,"cfile_init":1,"dirs.queue_time_us":18,"dirs.run_cpu_time_us":90,"dirs.run_wall_time_us":453,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1152,"lbm_writes_lt_1ms":35,"peak_mem_usage":0,"rows_written":12300}
I20260615 08:08:56.531581 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 114359 bytes on disk
I20260615 08:08:56.532462 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":23,"lbm_reads_lt_1ms":4}
I20260615 08:08:56.532655 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.010992
I20260615 08:08:56.652580 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.493s user 0.366s sys 0.042s Metrics: {"bytes_written":9851963,"cfile_cache_hit":13,"cfile_cache_hit_bytes":975675,"cfile_cache_miss":435,"cfile_cache_miss_bytes":24931129,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":72,"dirs.run_cpu_time_us":129,"dirs.run_wall_time_us":600,"drs_written":1,"lbm_read_time_us":11177,"lbm_reads_lt_1ms":455,"lbm_write_time_us":19566,"lbm_writes_lt_1ms":437,"num_input_rowsets":2,"peak_mem_usage":5668413,"rows_written":353550,"spinlock_wait_cycles":931712,"thread_start_us":153,"threads_started":4}
I20260615 08:08:56.652916 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:56.677930 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.025s user 0.019s sys 0.000s Metrics: {"bytes_written":386275,"cfile_init":1,"dirs.queue_time_us":21,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":912,"lbm_writes_lt_1ms":36,"peak_mem_usage":0,"rows_written":13450}
I20260615 08:08:56.678215 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 4092127 bytes on disk
I20260615 08:08:56.678475 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":34,"lbm_reads_lt_1ms":8}
I20260615 08:08:56.680562 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.010946
I20260615 08:08:56.890092 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.506s user 0.399s sys 0.015s Metrics: {"bytes_written":9991984,"cfile_cache_hit":11,"cfile_cache_hit_bytes":539299,"cfile_cache_miss":443,"cfile_cache_miss_bytes":25734405,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":74,"dirs.run_cpu_time_us":113,"dirs.run_wall_time_us":836,"drs_written":1,"lbm_read_time_us":13437,"lbm_reads_lt_1ms":471,"lbm_write_time_us":19811,"lbm_writes_lt_1ms":442,"num_input_rowsets":2,"peak_mem_usage":5748906,"rows_written":358550,"spinlock_wait_cycles":2840576,"thread_start_us":144,"threads_started":4}
I20260615 08:08:56.890430 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 4024393 bytes on disk
I20260615 08:08:56.890614 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20260615 08:08:56.890763 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:56.916216 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.025s user 0.018s sys 0.000s Metrics: {"bytes_written":382218,"cfile_init":1,"dirs.queue_time_us":27,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":970,"lbm_writes_lt_1ms":36,"peak_mem_usage":0,"rows_written":13300}
I20260615 08:08:56.916658 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1054759 bytes of WAL
I20260615 08:08:56.916785 14698 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:56.916838 14698 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000012 (ops 6814-7410)
I20260615 08:08:56.917232 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:56.917685 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 124162 bytes on disk
I20260615 08:08:56.917884 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":21,"lbm_reads_lt_1ms":4}
I20260615 08:08:56.918097 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.010938
I20260615 08:08:57.113976 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.581s user 0.423s sys 0.022s Metrics: {"bytes_written":10107822,"cfile_cache_hit":12,"cfile_cache_hit_bytes":699338,"cfile_cache_miss":446,"cfile_cache_miss_bytes":25871984,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":50,"dirs.run_cpu_time_us":120,"dirs.run_wall_time_us":582,"drs_written":1,"lbm_read_time_us":16017,"lbm_reads_lt_1ms":466,"lbm_write_time_us":24277,"lbm_writes_lt_1ms":448,"num_input_rowsets":2,"peak_mem_usage":5818089,"rows_written":362700,"spinlock_wait_cycles":3840,"thread_start_us":223,"threads_started":5}
I20260615 08:08:57.114504 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 4073267 bytes on disk
I20260615 08:08:57.115469 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":599,"lbm_reads_lt_1ms":4}
I20260615 08:08:57.115715 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:57.142412 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.462s user 0.387s sys 0.035s Metrics: {"bytes_written":10223777,"cfile_cache_hit":10,"cfile_cache_hit_bytes":521534,"cfile_cache_miss":454,"cfile_cache_miss_bytes":26366332,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":154,"dirs.run_cpu_time_us":122,"dirs.run_wall_time_us":663,"drs_written":1,"lbm_read_time_us":13655,"lbm_reads_lt_1ms":474,"lbm_write_time_us":19511,"lbm_writes_lt_1ms":452,"num_input_rowsets":2,"peak_mem_usage":5883505,"rows_written":367000,"spinlock_wait_cycles":1609856}
I20260615 08:08:57.142765 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 4122780 bytes on disk
I20260615 08:08:57.143008 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:08:57.143179 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:57.150152 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.034s user 0.014s sys 0.007s Metrics: {"bytes_written":388946,"cfile_init":1,"dirs.queue_time_us":24,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1112,"lbm_writes_lt_1ms":36,"peak_mem_usage":0,"rows_written":13550}
I20260615 08:08:57.150609 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1054335 bytes of WAL
I20260615 08:08:57.150766 14547 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:57.150833 14547 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000012 (ops 6796-7392)
I20260615 08:08:57.151270 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:57.151391 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 127997 bytes on disk
I20260615 08:08:57.151537 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20260615 08:08:57.151657 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.010787
I20260615 08:08:57.169276 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.026s user 0.014s sys 0.000s Metrics: {"bytes_written":283170,"cfile_init":1,"dirs.queue_time_us":1560,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1776,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9850,"spinlock_wait_cycles":1044864}
I20260615 08:08:57.169502 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.010837
I20260615 08:08:57.430290 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.512s user 0.393s sys 0.043s Metrics: {"bytes_written":10360228,"cfile_cache_hit":10,"cfile_cache_hit_bytes":518693,"cfile_cache_miss":458,"cfile_cache_miss_bytes":26729231,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":73,"dirs.run_cpu_time_us":118,"dirs.run_wall_time_us":640,"drs_written":1,"lbm_read_time_us":15236,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":477,"lbm_write_time_us":21246,"lbm_writes_lt_1ms":458,"num_input_rowsets":2,"peak_mem_usage":5964113,"rows_written":371850,"spinlock_wait_cycles":384,"thread_start_us":228,"threads_started":5}
I20260615 08:08:57.430676 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:57.454042 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.023s user 0.016s sys 0.000s Metrics: {"bytes_written":349149,"cfile_init":1,"dirs.queue_time_us":26,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":850,"lbm_writes_lt_1ms":35,"peak_mem_usage":0,"rows_written":12050,"spinlock_wait_cycles":384}
I20260615 08:08:57.454290 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 4291462 bytes on disk
I20260615 08:08:57.454555 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":58,"lbm_reads_lt_1ms":8}
I20260615 08:08:57.454741 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.010953
I20260615 08:08:57.592881 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.441s user 0.399s sys 0.024s Metrics: {"bytes_written":10481829,"cfile_cache_hit":14,"cfile_cache_hit_bytes":1050572,"cfile_cache_miss":460,"cfile_cache_miss_bytes":26523158,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":574,"dirs.run_cpu_time_us":107,"dirs.run_wall_time_us":602,"drs_written":1,"lbm_read_time_us":12068,"lbm_reads_lt_1ms":480,"lbm_write_time_us":19443,"lbm_writes_lt_1ms":464,"num_input_rowsets":2,"peak_mem_usage":6035356,"rows_written":376250,"spinlock_wait_cycles":1152}
I20260615 08:08:57.593173 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:57.613750 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.020s user 0.016s sys 0.000s Metrics: {"bytes_written":330685,"cfile_init":1,"dirs.queue_time_us":29,"dirs.run_cpu_time_us":81,"dirs.run_wall_time_us":5676,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":689,"lbm_writes_lt_1ms":34,"peak_mem_usage":0,"rows_written":11500}
I20260615 08:08:57.613973 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.010914
I20260615 08:08:57.704931 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.535s user 0.393s sys 0.039s Metrics: {"bytes_written":10496920,"cfile_cache_hit":12,"cfile_cache_hit_bytes":644700,"cfile_cache_miss":462,"cfile_cache_miss_bytes":26977028,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":30,"dirs.run_cpu_time_us":113,"dirs.run_wall_time_us":12460,"drs_written":1,"lbm_read_time_us":12593,"lbm_reads_lt_1ms":486,"lbm_write_time_us":24077,"lbm_writes_1-10_ms":3,"lbm_writes_lt_1ms":461,"num_input_rowsets":2,"peak_mem_usage":6048813,"rows_written":376850,"spinlock_wait_cycles":1664}
I20260615 08:08:57.705178 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 4236940 bytes on disk
I20260615 08:08:57.706796 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20260615 08:08:57.706992 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:57.772025 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.065s user 0.016s sys 0.001s Metrics: {"bytes_written":398126,"cfile_init":1,"dirs.queue_time_us":13959,"dirs.run_cpu_time_us":75,"dirs.run_wall_time_us":626,"drs_written":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4,"lbm_write_time_us":721,"lbm_writes_lt_1ms":37,"peak_mem_usage":0,"rows_written":13750,"spinlock_wait_cycles":1084800}
I20260615 08:08:57.773882 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 128577 bytes on disk
I20260615 08:08:57.774062 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":22,"lbm_reads_lt_1ms":4}
I20260615 08:08:57.774238 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.010884
I20260615 08:08:57.992273 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.537s user 0.402s sys 0.044s Metrics: {"bytes_written":10692164,"cfile_cache_hit":15,"cfile_cache_hit_bytes":1073378,"cfile_cache_miss":467,"cfile_cache_miss_bytes":27064800,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":49,"dirs.run_cpu_time_us":120,"dirs.run_wall_time_us":803,"drs_written":1,"lbm_read_time_us":16334,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":486,"lbm_write_time_us":21237,"lbm_writes_lt_1ms":472,"num_input_rowsets":2,"peak_mem_usage":6159518,"rows_written":383900,"spinlock_wait_cycles":34560,"thread_start_us":701,"threads_started":5}
I20260615 08:08:57.992524 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:58.031950 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.039s user 0.020s sys 0.003s Metrics: {"bytes_written":436050,"cfile_init":1,"dirs.queue_time_us":24,"dirs.run_cpu_time_us":89,"dirs.run_wall_time_us":416,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1092,"lbm_writes_lt_1ms":39,"peak_mem_usage":0,"rows_written":15250}
I20260615 08:08:58.032183 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.010737
I20260615 08:08:58.104149 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.490s user 0.392s sys 0.032s Metrics: {"bytes_written":10798735,"cfile_cache_hit":12,"cfile_cache_hit_bytes":681190,"cfile_cache_miss":476,"cfile_cache_miss_bytes":27736128,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":151,"dirs.run_cpu_time_us":108,"dirs.run_wall_time_us":702,"drs_written":1,"lbm_read_time_us":12881,"lbm_reads_lt_1ms":504,"lbm_write_time_us":20938,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":476,"num_input_rowsets":2,"peak_mem_usage":6224271,"rows_written":387750,"spinlock_wait_cycles":319616,"thread_start_us":126,"threads_started":3}
I20260615 08:08:58.104507 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:58.153754 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.049s user 0.022s sys 0.001s Metrics: {"bytes_written":433535,"cfile_init":1,"dirs.queue_time_us":4713,"dirs.run_cpu_time_us":75,"dirs.run_wall_time_us":2213,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":5938,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":37,"peak_mem_usage":0,"rows_written":15150}
I20260615 08:08:58.153926 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1050891 bytes of WAL
I20260615 08:08:58.154033 14547 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:58.154078 14547 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000013 (ops 7393-7984)
I20260615 08:08:58.154466 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:58.154598 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 4506090 bytes on disk
I20260615 08:08:58.154771 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":38,"lbm_reads_lt_1ms":8}
I20260615 08:08:58.154897 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.010737
I20260615 08:08:58.443738 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.669s user 0.407s sys 0.048s Metrics: {"bytes_written":10876689,"cfile_cache_hit":13,"cfile_cache_hit_bytes":892505,"cfile_cache_miss":477,"cfile_cache_miss_bytes":27732165,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":132,"dirs.run_cpu_time_us":119,"dirs.run_wall_time_us":21679,"drs_written":1,"lbm_read_time_us":16029,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":496,"lbm_write_time_us":44628,"lbm_writes_1-10_ms":3,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":476,"num_input_rowsets":2,"peak_mem_usage":6266679,"rows_written":390600,"spinlock_wait_cycles":1664,"thread_start_us":80,"threads_started":1}
I20260615 08:08:58.444052 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1054995 bytes of WAL
I20260615 08:08:58.444203 14623 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:58.444273 14623 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000013 (ops 7026-7606)
I20260615 08:08:58.444732 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:58.444917 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.937278
I20260615 08:08:58.480497 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.035s user 0.029s sys 0.000s Metrics: {"bytes_written":704407,"cfile_init":1,"dirs.queue_time_us":115,"dirs.run_cpu_time_us":92,"dirs.run_wall_time_us":481,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1809,"lbm_writes_lt_1ms":49,"peak_mem_usage":0,"rows_written":24700}
I20260615 08:08:58.480728 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1053424 bytes of WAL
I20260615 08:08:58.480813 14623 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:58.480846 14623 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000014 (ops 7607-8186)
I20260615 08:08:58.481240 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:58.481364 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 4636959 bytes on disk
I20260615 08:08:58.481597 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":34,"lbm_reads_lt_1ms":8}
I20260615 08:08:58.481746 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.010609
I20260615 08:08:58.551283 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.519s user 0.419s sys 0.048s Metrics: {"bytes_written":11114920,"cfile_cache_hit":14,"cfile_cache_hit_bytes":1058820,"cfile_cache_miss":488,"cfile_cache_miss_bytes":28191100,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":49,"dirs.run_cpu_time_us":78,"dirs.run_wall_time_us":8980,"drs_written":1,"lbm_read_time_us":14432,"lbm_reads_lt_1ms":516,"lbm_write_time_us":27811,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":489,"num_input_rowsets":2,"peak_mem_usage":6405758,"rows_written":399150,"spinlock_wait_cycles":1152,"thread_start_us":207,"threads_started":5}
I20260615 08:08:58.551623 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:58.584884 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.033s user 0.015s sys 0.013s Metrics: {"bytes_written":526759,"cfile_init":1,"dirs.queue_time_us":22,"dirs.run_cpu_time_us":98,"dirs.run_wall_time_us":487,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2491,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":41,"peak_mem_usage":0,"rows_written":18500}
I20260615 08:08:58.585194 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1049357 bytes of WAL
I20260615 08:08:58.585350 14698 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:58.585436 14698 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000013 (ops 7411-8044)
I20260615 08:08:58.585901 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:58.586071 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.010555
I20260615 08:08:58.987483 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.506s user 0.423s sys 0.052s Metrics: {"bytes_written":11559794,"cfile_cache_hit":14,"cfile_cache_hit_bytes":996137,"cfile_cache_miss":504,"cfile_cache_miss_bytes":29428195,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":55,"dirs.run_cpu_time_us":110,"dirs.run_wall_time_us":587,"drs_written":1,"lbm_read_time_us":15817,"lbm_reads_lt_1ms":524,"lbm_write_time_us":22039,"lbm_writes_lt_1ms":510,"num_input_rowsets":2,"peak_mem_usage":6660367,"rows_written":415300,"spinlock_wait_cycles":4224,"thread_start_us":256,"threads_started":5}
I20260615 08:08:58.987784 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 4681944 bytes on disk
I20260615 08:08:58.988003 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:08:58.988160 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:58.997846 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.843s user 0.429s sys 0.043s Metrics: {"bytes_written":11216895,"cfile_cache_hit":16,"cfile_cache_hit_bytes":1379985,"cfile_cache_miss":490,"cfile_cache_miss_bytes":28150863,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":29504,"dirs.run_cpu_time_us":121,"dirs.run_wall_time_us":11584,"drs_written":1,"lbm_read_time_us":20536,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":509,"lbm_write_time_us":35504,"lbm_writes_1-10_ms":6,"lbm_writes_lt_1ms":490,"num_input_rowsets":2,"peak_mem_usage":6465143,"rows_written":402900,"spinlock_wait_cycles":1152,"thread_start_us":319,"threads_started":6}
I20260615 08:08:58.998296 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 4538675 bytes on disk
I20260615 08:08:58.998453 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20260615 08:08:58.998638 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.937278
I20260615 08:08:59.007643 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.019s user 0.015s sys 0.003s Metrics: {"bytes_written":373179,"cfile_init":1,"dirs.queue_time_us":225,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":934,"lbm_writes_lt_1ms":35,"peak_mem_usage":0,"rows_written":12950}
I20260615 08:08:59.007877 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.010467
I20260615 08:08:59.053244 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.055s user 0.030s sys 0.000s Metrics: {"bytes_written":727977,"cfile_init":1,"dirs.queue_time_us":27,"dirs.run_cpu_time_us":86,"dirs.run_wall_time_us":3584,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1479,"lbm_writes_lt_1ms":49,"peak_mem_usage":0,"rows_written":25600}
I20260615 08:08:59.053514 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 245949 bytes on disk
I20260615 08:08:59.053735 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:08:59.053906 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.010470
I20260615 08:08:59.098150 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.512s user 0.459s sys 0.040s Metrics: {"bytes_written":11625175,"cfile_cache_hit":13,"cfile_cache_hit_bytes":1011118,"cfile_cache_miss":511,"cfile_cache_miss_bytes":29593754,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":48,"dirs.run_cpu_time_us":131,"dirs.run_wall_time_us":613,"drs_written":1,"lbm_read_time_us":15319,"lbm_reads_lt_1ms":539,"lbm_write_time_us":23404,"lbm_writes_lt_1ms":513,"num_input_rowsets":2,"peak_mem_usage":6703109,"rows_written":417650,"spinlock_wait_cycles":4736,"thread_start_us":219,"threads_started":5}
I20260615 08:08:59.098500 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:59.123788 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.025s user 0.019s sys 0.000s Metrics: {"bytes_written":377075,"cfile_init":1,"dirs.queue_time_us":24,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":868,"lbm_writes_lt_1ms":36,"peak_mem_usage":0,"rows_written":13100}
I20260615 08:08:59.124080 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 4830715 bytes on disk
I20260615 08:08:59.124341 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":38,"lbm_reads_lt_1ms":8}
I20260615 08:08:59.124544 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.010441
I20260615 08:08:59.519755 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.512s user 0.451s sys 0.035s Metrics: {"bytes_written":11919749,"cfile_cache_hit":14,"cfile_cache_hit_bytes":1033205,"cfile_cache_miss":522,"cfile_cache_miss_bytes":30368513,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":170,"dirs.run_cpu_time_us":127,"dirs.run_wall_time_us":838,"drs_written":1,"lbm_read_time_us":14729,"lbm_reads_lt_1ms":546,"lbm_write_time_us":23984,"lbm_writes_lt_1ms":525,"num_input_rowsets":2,"peak_mem_usage":6884207,"rows_written":428250,"spinlock_wait_cycles":896}
I20260615 08:08:59.519989 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 4832233 bytes on disk
I20260615 08:08:59.520184 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20260615 08:08:59.520316 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:59.543097 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.022s user 0.013s sys 0.004s Metrics: {"bytes_written":334328,"cfile_init":1,"dirs.queue_time_us":22,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1842,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":33,"peak_mem_usage":0,"rows_written":11650}
I20260615 08:08:59.543351 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1053333 bytes of WAL
I20260615 08:08:59.543850 14623 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:59.543951 14623 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000015 (ops 8187-8766)
I20260615 08:08:59.544360 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:59.544497 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 109243 bytes on disk
I20260615 08:08:59.544682 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20260615 08:08:59.544826 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.009804
I20260615 08:08:59.651113 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.526s user 0.483s sys 0.028s Metrics: {"bytes_written":11986230,"cfile_cache_hit":13,"cfile_cache_hit_bytes":995945,"cfile_cache_miss":527,"cfile_cache_miss_bytes":30584021,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":44,"dirs.run_cpu_time_us":82,"dirs.run_wall_time_us":1596,"drs_written":1,"lbm_read_time_us":16460,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":546,"lbm_write_time_us":26727,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":527,"num_input_rowsets":2,"peak_mem_usage":6924674,"rows_written":430750,"spinlock_wait_cycles":932992,"thread_start_us":194,"threads_started":5}
I20260615 08:08:59.651448 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:59.688047 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.036s user 0.017s sys 0.000s Metrics: {"bytes_written":353150,"cfile_init":1,"dirs.queue_time_us":614,"dirs.run_cpu_time_us":93,"dirs.run_wall_time_us":1416,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2528,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":34,"peak_mem_usage":0,"rows_written":12200}
I20260615 08:08:59.688268 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1055129 bytes of WAL
I20260615 08:08:59.688367 14698 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:59.688405 14698 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000014 (ops 8045-8660)
I20260615 08:08:59.688820 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:59.688968 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 4974471 bytes on disk
I20260615 08:08:59.689142 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":33,"lbm_reads_lt_1ms":8}
I20260615 08:08:59.689280 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.010030
I20260615 08:08:59.761674 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.708s user 0.450s sys 0.043s Metrics: {"bytes_written":11926194,"cfile_cache_hit":17,"cfile_cache_hit_bytes":1567177,"cfile_cache_miss":519,"cfile_cache_miss_bytes":29822317,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":14968,"dirs.run_cpu_time_us":116,"dirs.run_wall_time_us":902,"drs_written":1,"lbm_read_time_us":25502,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":537,"lbm_write_time_us":28957,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":523,"num_input_rowsets":2,"peak_mem_usage":6877251,"rows_written":428500,"thread_start_us":367,"threads_started":6}
I20260615 08:08:59.761987 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 4834281 bytes on disk
I20260615 08:08:59.763161 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:08:59.763878 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:08:59.793561 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.030s user 0.017s sys 0.006s Metrics: {"bytes_written":497097,"cfile_init":1,"dirs.queue_time_us":24,"dirs.run_cpu_time_us":83,"dirs.run_wall_time_us":4555,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2381,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":40,"peak_mem_usage":0,"rows_written":17350}
I20260615 08:08:59.793835 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1052613 bytes of WAL
I20260615 08:08:59.794010 14547 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:08:59.794094 14547 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000014 (ops 7985-8595)
I20260615 08:08:59.794548 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:08:59.794692 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.010305
I20260615 08:09:00.113276 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.568s user 0.450s sys 0.054s Metrics: {"bytes_written":12243082,"cfile_cache_hit":12,"cfile_cache_hit_bytes":807448,"cfile_cache_miss":538,"cfile_cache_miss_bytes":31456510,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":286,"dirs.run_cpu_time_us":111,"dirs.run_wall_time_us":761,"drs_written":1,"lbm_read_time_us":15096,"lbm_reads_lt_1ms":558,"lbm_write_time_us":23863,"lbm_writes_lt_1ms":538,"num_input_rowsets":2,"peak_mem_usage":7071505,"rows_written":439900,"spinlock_wait_cycles":3840}
I20260615 08:09:00.113785 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 4965835 bytes on disk
I20260615 08:09:00.114007 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:09:00.114156 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:09:00.133468 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.019s user 0.014s sys 0.004s Metrics: {"bytes_written":382263,"cfile_init":1,"dirs.queue_time_us":111,"drs_written":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4,"lbm_write_time_us":923,"lbm_writes_lt_1ms":36,"peak_mem_usage":0,"rows_written":13300}
I20260615 08:09:00.133669 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 124163 bytes on disk
I20260615 08:09:00.133955 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":23,"lbm_reads_lt_1ms":4}
I20260615 08:09:00.134111 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.010227
I20260615 08:09:00.347508 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.553s user 0.463s sys 0.044s Metrics: {"bytes_written":12403246,"cfile_cache_hit":12,"cfile_cache_hit_bytes":741720,"cfile_cache_miss":544,"cfile_cache_miss_bytes":31942556,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":32,"dirs.run_cpu_time_us":110,"dirs.run_wall_time_us":692,"drs_written":1,"lbm_read_time_us":18460,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":567,"lbm_write_time_us":24605,"lbm_writes_lt_1ms":545,"num_input_rowsets":2,"peak_mem_usage":7165781,"rows_written":445850,"spinlock_wait_cycles":4096}
I20260615 08:09:00.347821 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 5035228 bytes on disk
I20260615 08:09:00.348052 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20260615 08:09:00.348237 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:09:00.367871 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.677s user 0.461s sys 0.065s Metrics: {"bytes_written":12327700,"cfile_cache_hit":15,"cfile_cache_hit_bytes":1174922,"cfile_cache_miss":539,"cfile_cache_miss_bytes":31309152,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":297,"dirs.run_cpu_time_us":111,"dirs.run_wall_time_us":884,"drs_written":1,"lbm_read_time_us":19002,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":558,"lbm_write_time_us":26881,"lbm_writes_lt_1ms":543,"num_input_rowsets":2,"peak_mem_usage":7123809,"rows_written":442950,"spinlock_wait_cycles":205440,"thread_start_us":54,"threads_started":1}
I20260615 08:09:00.368538 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 5001930 bytes on disk
I20260615 08:09:00.368759 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20260615 08:09:00.369331 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:09:00.402619 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.054s user 0.017s sys 0.002s Metrics: {"bytes_written":358484,"cfile_init":1,"dirs.queue_time_us":21,"drs_written":1,"lbm_read_time_us":692,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2109,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":34,"peak_mem_usage":0,"rows_written":12400}
I20260615 08:09:00.402834 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.010158
I20260615 08:09:00.435812 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.063s user 0.024s sys 0.001s Metrics: {"bytes_written":452649,"cfile_init":1,"dirs.queue_time_us":3330,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":9089,"lbm_writes_1-10_ms":4,"lbm_writes_lt_1ms":36,"peak_mem_usage":0,"rows_written":15750}
I20260615 08:09:00.436770 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 150390 bytes on disk
I20260615 08:09:00.437407 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":24,"lbm_reads_lt_1ms":4}
I20260615 08:09:00.437779 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.010168
I20260615 08:09:00.697090 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.563s user 0.491s sys 0.028s Metrics: {"bytes_written":12609692,"cfile_cache_hit":14,"cfile_cache_hit_bytes":1039875,"cfile_cache_miss":550,"cfile_cache_miss_bytes":32197775,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":261,"dirs.run_cpu_time_us":122,"dirs.run_wall_time_us":701,"drs_written":1,"lbm_read_time_us":15070,"lbm_reads_lt_1ms":570,"lbm_write_time_us":28639,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":552,"num_input_rowsets":2,"peak_mem_usage":7290913,"rows_written":453200,"spinlock_wait_cycles":3840,"thread_start_us":224,"threads_started":5}
I20260615 08:09:00.697474 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 5120238 bytes on disk
I20260615 08:09:00.697827 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":172,"lbm_reads_lt_1ms":4}
I20260615 08:09:00.698004 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:09:00.727474 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.029s user 0.020s sys 0.000s Metrics: {"bytes_written":402049,"cfile_init":1,"dirs.queue_time_us":32,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":937,"lbm_writes_lt_1ms":38,"peak_mem_usage":0,"rows_written":13900}
I20260615 08:09:00.727768 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.010075
I20260615 08:09:01.162364 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.724s user 0.482s sys 0.055s Metrics: {"bytes_written":12760569,"cfile_cache_hit":18,"cfile_cache_hit_bytes":1655165,"cfile_cache_miss":556,"cfile_cache_miss_bytes":31984181,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":13160,"dirs.run_cpu_time_us":115,"dirs.run_wall_time_us":1053,"drs_written":1,"lbm_read_time_us":24615,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":574,"lbm_write_time_us":33061,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":560,"num_input_rowsets":2,"peak_mem_usage":7374529,"rows_written":458700,"spinlock_wait_cycles":6784,"thread_start_us":322,"threads_started":6}
I20260615 08:09:01.162845 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.937278
I20260615 08:09:01.214844 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.052s user 0.027s sys 0.004s Metrics: {"bytes_written":707024,"cfile_init":1,"dirs.queue_time_us":27,"dirs.run_cpu_time_us":100,"dirs.run_wall_time_us":494,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1568,"lbm_writes_lt_1ms":49,"peak_mem_usage":0,"rows_written":24800}
I20260615 08:09:01.215108 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1054859 bytes of WAL
I20260615 08:09:01.215260 14698 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:09:01.215324 14698 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000015 (ops 8661-9260)
I20260615 08:09:01.219115 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.004s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:01.219285 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 5421644 bytes on disk
I20260615 08:09:01.219517 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":39,"lbm_reads_lt_1ms":8}
I20260615 08:09:01.219664 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.009928
I20260615 08:09:01.258591 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.855s user 0.491s sys 0.041s Metrics: {"bytes_written":12746177,"cfile_cache_hit":17,"cfile_cache_hit_bytes":1496072,"cfile_cache_miss":553,"cfile_cache_miss_bytes":32114230,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":14338,"dirs.run_cpu_time_us":125,"dirs.run_wall_time_us":1178,"drs_written":1,"lbm_read_time_us":22910,"lbm_reads_lt_1ms":577,"lbm_write_time_us":37274,"lbm_writes_1-10_ms":3,"lbm_writes_lt_1ms":557,"num_input_rowsets":2,"peak_mem_usage":7372222,"rows_written":458250,"spinlock_wait_cycles":2944,"thread_start_us":287,"threads_started":6}
I20260615 08:09:01.259066 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.937278
I20260615 08:09:01.305526 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.046s user 0.030s sys 0.003s Metrics: {"bytes_written":794631,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":106,"dirs.run_wall_time_us":505,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2065,"lbm_writes_lt_1ms":53,"peak_mem_usage":0,"rows_written":27850}
I20260615 08:09:01.305815 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1048540 bytes of WAL
I20260615 08:09:01.306001 14547 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:09:01.306083 14547 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000015 (ops 8596-9184)
I20260615 08:09:01.306531 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:01.306706 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.009901
I20260615 08:09:01.445475 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.718s user 0.521s sys 0.038s Metrics: {"bytes_written":12993556,"cfile_cache_hit":12,"cfile_cache_hit_bytes":731337,"cfile_cache_miss":570,"cfile_cache_miss_bytes":33525555,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":13084,"dirs.run_cpu_time_us":170,"dirs.run_wall_time_us":606,"drs_written":1,"lbm_read_time_us":22802,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":592,"lbm_write_time_us":34905,"lbm_writes_lt_1ms":572,"num_input_rowsets":2,"peak_mem_usage":7516171,"rows_written":467100,"spinlock_wait_cycles":1280,"thread_start_us":394,"threads_started":6}
I20260615 08:09:01.445951 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.937278
I20260615 08:09:01.498769 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.053s user 0.027s sys 0.004s Metrics: {"bytes_written":696618,"cfile_init":1,"dirs.queue_time_us":16,"dirs.run_cpu_time_us":99,"dirs.run_wall_time_us":506,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2131,"lbm_writes_lt_1ms":49,"peak_mem_usage":0,"rows_written":24400}
I20260615 08:09:01.499183 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1055137 bytes of WAL
I20260615 08:09:01.499832 14623 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:09:01.499917 14623 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000016 (ops 8767-9347)
I20260615 08:09:01.500502 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:01.500661 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.009801
I20260615 08:09:01.950282 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.643s user 0.520s sys 0.039s Metrics: {"bytes_written":13517430,"cfile_cache_hit":15,"cfile_cache_hit_bytes":1248462,"cfile_cache_miss":589,"cfile_cache_miss_bytes":34380836,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":10925,"dirs.run_cpu_time_us":130,"dirs.run_wall_time_us":3335,"drs_written":1,"lbm_read_time_us":17669,"lbm_reads_lt_1ms":617,"lbm_write_time_us":29967,"lbm_writes_lt_1ms":594,"num_input_rowsets":2,"peak_mem_usage":7807636,"rows_written":486100,"spinlock_wait_cycles":2645120,"thread_start_us":282,"threads_started":6}
I20260615 08:09:01.950641 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.937278
I20260615 08:09:01.963879 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.744s user 0.513s sys 0.046s Metrics: {"bytes_written":13444611,"cfile_cache_hit":16,"cfile_cache_hit_bytes":1397298,"cfile_cache_miss":584,"cfile_cache_miss_bytes":34039824,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":10907,"dirs.run_cpu_time_us":122,"dirs.run_wall_time_us":2188,"drs_written":1,"lbm_read_time_us":16631,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":603,"lbm_write_time_us":36696,"lbm_writes_1-10_ms":7,"lbm_writes_lt_1ms":583,"num_input_rowsets":2,"peak_mem_usage":7771738,"rows_written":483500,"spinlock_wait_cycles":984448,"thread_start_us":81,"threads_started":1}
I20260615 08:09:01.964643 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.937278
I20260615 08:09:01.991654 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.040s user 0.018s sys 0.009s Metrics: {"bytes_written":576177,"cfile_init":1,"dirs.queue_time_us":27,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1346,"lbm_writes_lt_1ms":44,"peak_mem_usage":0,"rows_written":20250}
I20260615 08:09:01.992295 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1061529 bytes of WAL
I20260615 08:09:01.992448 14547 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:09:01.992516 14547 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000016 (ops 9185-9811)
I20260615 08:09:01.992965 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:01.993101 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.009535
I20260615 08:09:02.005618 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.041s user 0.021s sys 0.008s Metrics: {"bytes_written":656267,"cfile_init":1,"dirs.queue_time_us":22,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1655,"lbm_writes_lt_1ms":47,"peak_mem_usage":0,"rows_written":23000}
I20260615 08:09:02.005949 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1054989 bytes of WAL
I20260615 08:09:02.006690 14698 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:09:02.006765 14698 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000016 (ops 9261-9893)
I20260615 08:09:02.007787 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:02.007926 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.009534
I20260615 08:09:02.325177 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.824s user 0.506s sys 0.070s Metrics: {"bytes_written":13666750,"cfile_cache_hit":19,"cfile_cache_hit_bytes":1870821,"cfile_cache_miss":593,"cfile_cache_miss_bytes":34164589,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":105,"dirs.run_cpu_time_us":120,"dirs.run_wall_time_us":2636,"drs_written":1,"lbm_read_time_us":21677,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":620,"lbm_write_time_us":38263,"lbm_writes_1-10_ms":5,"lbm_writes_lt_1ms":595,"num_input_rowsets":2,"peak_mem_usage":7902129,"rows_written":491500,"spinlock_wait_cycles":3328,"thread_start_us":76,"threads_started":1}
I20260615 08:09:02.325430 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 5562383 bytes on disk
I20260615 08:09:02.326081 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":21,"lbm_reads_lt_1ms":4}
I20260615 08:09:02.326236 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.937278
I20260615 08:09:02.385632 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.059s user 0.027s sys 0.004s Metrics: {"bytes_written":708505,"cfile_init":1,"dirs.queue_time_us":20,"dirs.run_cpu_time_us":88,"dirs.run_wall_time_us":477,"drs_written":1,"lbm_read_time_us":202,"lbm_reads_lt_1ms":4,"lbm_write_time_us":5998,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":48,"peak_mem_usage":0,"rows_written":24850}
I20260615 08:09:02.385881 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1113504 bytes of WAL
I20260615 08:09:02.386039 14623 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:09:02.386114 14623 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000017 (ops 9348-9960)
I20260615 08:09:02.386646 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:02.386788 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 240550 bytes on disk
I20260615 08:09:02.386991 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":21,"lbm_reads_lt_1ms":4}
I20260615 08:09:02.387141 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.009434
I20260615 08:09:02.666044 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.673s user 0.529s sys 0.049s Metrics: {"bytes_written":14077824,"cfile_cache_hit":12,"cfile_cache_hit_bytes":846790,"cfile_cache_miss":618,"cfile_cache_miss_bytes":36277486,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":11123,"dirs.run_cpu_time_us":116,"dirs.run_wall_time_us":8015,"drs_written":1,"lbm_read_time_us":16684,"lbm_reads_lt_1ms":646,"lbm_write_time_us":34629,"lbm_writes_1-10_ms":3,"lbm_writes_lt_1ms":614,"num_input_rowsets":2,"peak_mem_usage":8145934,"rows_written":506350,"spinlock_wait_cycles":11776,"thread_start_us":365,"threads_started":6}
I20260615 08:09:02.666661 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 5733496 bytes on disk
I20260615 08:09:02.672366 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":46,"lbm_reads_lt_1ms":4}
I20260615 08:09:02.673702 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.937278
I20260615 08:09:02.722707 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.048s user 0.027s sys 0.005s Metrics: {"bytes_written":615524,"cfile_init":1,"dirs.queue_time_us":20,"dirs.run_cpu_time_us":111,"dirs.run_wall_time_us":499,"drs_written":1,"lbm_read_time_us":22,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3018,"lbm_writes_lt_1ms":45,"peak_mem_usage":0,"rows_written":21600}
I20260615 08:09:02.722975 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1049298 bytes of WAL
I20260615 08:09:02.723218 14547 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:09:02.723299 14547 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000017 (ops 9812-10402)
I20260615 08:09:02.723757 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:02.723896 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.009332
I20260615 08:09:02.730248 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.722s user 0.539s sys 0.060s Metrics: {"bytes_written":14082133,"cfile_cache_hit":16,"cfile_cache_hit_bytes":1389873,"cfile_cache_miss":612,"cfile_cache_miss_bytes":35743609,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":25556,"dirs.run_cpu_time_us":112,"dirs.run_wall_time_us":1279,"drs_written":1,"lbm_read_time_us":27231,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":639,"lbm_write_time_us":29494,"lbm_writes_lt_1ms":617,"num_input_rowsets":2,"peak_mem_usage":8147268,"rows_written":506500,"spinlock_wait_cycles":768,"thread_start_us":1719,"threads_started":6}
I20260615 08:09:02.730639 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.937278
I20260615 08:09:02.768172 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.037s user 0.021s sys 0.008s Metrics: {"bytes_written":650968,"cfile_init":1,"dirs.queue_time_us":24,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1507,"lbm_writes_lt_1ms":47,"peak_mem_usage":0,"rows_written":22800}
I20260615 08:09:02.768468 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1049615 bytes of WAL
I20260615 08:09:02.768658 14698 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:09:02.768747 14698 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000017 (ops 9894-10551)
I20260615 08:09:02.769407 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:02.769659 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 5957436 bytes on disk
I20260615 08:09:02.769948 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":39,"lbm_reads_lt_1ms":8}
I20260615 08:09:02.770308 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.009282
I20260615 08:09:03.179234 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.792s user 0.546s sys 0.046s Metrics: {"bytes_written":14350306,"cfile_cache_hit":20,"cfile_cache_hit_bytes":2028699,"cfile_cache_miss":620,"cfile_cache_miss_bytes":35829787,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":16433,"dirs.run_cpu_time_us":128,"dirs.run_wall_time_us":560,"drs_written":1,"lbm_read_time_us":22937,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":638,"lbm_write_time_us":34827,"lbm_writes_1-10_ms":3,"lbm_writes_lt_1ms":625,"num_input_rowsets":2,"peak_mem_usage":8303817,"rows_written":516350,"spinlock_wait_cycles":2432,"thread_start_us":88,"threads_started":1}
I20260615 08:09:03.179433 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.937278
I20260615 08:09:03.222218 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.042s user 0.030s sys 0.000s Metrics: {"bytes_written":734534,"cfile_init":1,"dirs.queue_time_us":23,"dirs.run_cpu_time_us":78,"dirs.run_wall_time_us":7644,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1773,"lbm_writes_lt_1ms":50,"peak_mem_usage":0,"rows_written":25700}
I20260615 08:09:03.223098 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1060553 bytes of WAL
I20260615 08:09:03.223260 14623 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:09:03.224635 14623 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000018 (ops 9961-10544)
I20260615 08:09:03.225101 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.002s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:03.226784 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 6096807 bytes on disk
I20260615 08:09:03.226958 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":34,"lbm_reads_lt_1ms":8}
I20260615 08:09:03.227108 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.009297
I20260615 08:09:03.457792 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.687s user 0.589s sys 0.036s Metrics: {"bytes_written":14708517,"cfile_cache_hit":18,"cfile_cache_hit_bytes":1704086,"cfile_cache_miss":636,"cfile_cache_miss_bytes":37113164,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":37079,"dirs.run_cpu_time_us":139,"dirs.run_wall_time_us":5154,"drs_written":1,"lbm_read_time_us":19708,"lbm_reads_lt_1ms":656,"lbm_write_time_us":32221,"lbm_writes_lt_1ms":646,"num_input_rowsets":2,"peak_mem_usage":8517947,"rows_written":529300,"spinlock_wait_cycles":1216512,"thread_start_us":56,"threads_started":1}
I20260615 08:09:03.458109 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 6000925 bytes on disk
I20260615 08:09:03.458395 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20260615 08:09:03.458626 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.937278
I20260615 08:09:03.500039 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.041s user 0.027s sys 0.004s Metrics: {"bytes_written":658779,"cfile_init":1,"dirs.queue_time_us":19,"dirs.run_cpu_time_us":90,"dirs.run_wall_time_us":456,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1966,"lbm_writes_lt_1ms":47,"peak_mem_usage":0,"rows_written":23100}
I20260615 08:09:03.500329 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 224070 bytes on disk
I20260615 08:09:03.500586 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":25,"lbm_reads_lt_1ms":4}
I20260615 08:09:03.501017 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.009194
I20260615 08:09:03.760955 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 1.037s user 0.561s sys 0.050s Metrics: {"bytes_written":14672510,"cfile_cache_hit":19,"cfile_cache_hit_bytes":1857565,"cfile_cache_miss":633,"cfile_cache_miss_bytes":36859069,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":159519,"dirs.run_cpu_time_us":122,"dirs.run_wall_time_us":1598,"drs_written":1,"lbm_read_time_us":28660,"lbm_reads_1-10_ms":3,"lbm_reads_lt_1ms":654,"lbm_write_time_us":46434,"lbm_writes_1-10_ms":6,"lbm_writes_lt_1ms":638,"num_input_rowsets":2,"peak_mem_usage":8495559,"rows_written":527950,"spinlock_wait_cycles":1536,"thread_start_us":100,"threads_started":1}
I20260615 08:09:03.761307 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=2.929465
I20260615 08:09:03.824352 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.063s user 0.036s sys 0.003s Metrics: {"bytes_written":906738,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":93,"dirs.run_wall_time_us":552,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":6422,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":56,"peak_mem_usage":0,"rows_written":32000}
I20260615 08:09:03.824647 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1062498 bytes of WAL
I20260615 08:09:03.824779 14547 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:09:03.824853 14547 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000018 (ops 10403-11005)
I20260615 08:09:03.825429 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:03.825569 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 6300989 bytes on disk
I20260615 08:09:03.825765 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":40,"lbm_reads_lt_1ms":8}
I20260615 08:09:03.825889 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.009117
I20260615 08:09:04.028067 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.801s user 0.584s sys 0.039s Metrics: {"bytes_written":15061773,"cfile_cache_hit":17,"cfile_cache_hit_bytes":1514420,"cfile_cache_miss":651,"cfile_cache_miss_bytes":38227388,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":48567,"drs_written":1,"lbm_read_time_us":19418,"lbm_reads_lt_1ms":671,"lbm_write_time_us":34565,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":659,"num_input_rowsets":2,"peak_mem_usage":8720565,"rows_written":542050,"spinlock_wait_cycles":4608,"thread_start_us":95,"threads_started":1}
I20260615 08:09:04.028369 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.937278
I20260615 08:09:04.060930 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.032s user 0.024s sys 0.004s Metrics: {"bytes_written":688806,"cfile_init":1,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1627,"lbm_writes_lt_1ms":49,"peak_mem_usage":0,"rows_written":24100}
I20260615 08:09:04.061180 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1104293 bytes of WAL
I20260615 08:09:04.061304 14623 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:09:04.061367 14623 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000019 (ops 10545-11152)
I20260615 08:09:04.062237 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:04.062407 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.009043
I20260615 08:09:04.173292 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.672s user 0.586s sys 0.059s Metrics: {"bytes_written":15352540,"cfile_cache_hit":17,"cfile_cache_hit_bytes":1543165,"cfile_cache_miss":669,"cfile_cache_miss_bytes":38970467,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":14172,"dirs.run_cpu_time_us":93,"dirs.run_wall_time_us":530,"drs_written":1,"lbm_read_time_us":19461,"lbm_reads_lt_1ms":689,"lbm_write_time_us":30901,"lbm_writes_lt_1ms":672,"num_input_rowsets":2,"peak_mem_usage":8892995,"rows_written":552400,"spinlock_wait_cycles":5504,"thread_start_us":393,"threads_started":6}
I20260615 08:09:04.173686 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 6266917 bytes on disk
I20260615 08:09:04.174331 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20260615 08:09:04.174556 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:09:04.208709 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.034s user 0.016s sys 0.008s Metrics: {"bytes_written":505851,"cfile_init":1,"dirs.queue_time_us":23,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1319,"lbm_writes_lt_1ms":42,"peak_mem_usage":0,"rows_written":17700}
I20260615 08:09:04.210052 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1065736 bytes of WAL
I20260615 08:09:04.210245 14698 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:09:04.210422 14698 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000018 (ops 10552-11197)
I20260615 08:09:04.211100 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:04.211306 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 167332 bytes on disk
I20260615 08:09:04.211500 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":26,"lbm_reads_lt_1ms":4}
I20260615 08:09:04.211974 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.008978
I20260615 08:09:04.695583 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.870s user 0.571s sys 0.071s Metrics: {"bytes_written":15556565,"cfile_cache_hit":11,"cfile_cache_hit_bytes":624056,"cfile_cache_miss":683,"cfile_cache_miss_bytes":40432536,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":15052,"dirs.run_cpu_time_us":133,"dirs.run_wall_time_us":539,"drs_written":1,"lbm_read_time_us":39986,"lbm_reads_1-10_ms":1,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":701,"lbm_write_time_us":33238,"lbm_writes_lt_1ms":681,"num_input_rowsets":2,"peak_mem_usage":9005113,"rows_written":559950,"spinlock_wait_cycles":99328,"thread_start_us":69,"threads_started":1}
I20260615 08:09:04.696066 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.937278
I20260615 08:09:04.730203 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.033s user 0.022s sys 0.005s Metrics: {"bytes_written":640544,"cfile_init":1,"dirs.queue_time_us":2742,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2423,"lbm_writes_lt_1ms":47,"peak_mem_usage":0,"rows_written":22400}
I20260615 08:09:04.730744 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1077445 bytes of WAL
I20260615 08:09:04.731302 14547 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:09:04.731377 14547 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000019 (ops 11006-11607)
I20260615 08:09:04.731789 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:04.732606 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 6572523 bytes on disk
I20260615 08:09:04.732797 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":36,"lbm_reads_lt_1ms":8}
I20260615 08:09:04.732977 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.008850
I20260615 08:09:04.881831 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.670s user 0.627s sys 0.029s Metrics: {"bytes_written":15836529,"cfile_cache_hit":13,"cfile_cache_hit_bytes":898372,"cfile_cache_miss":693,"cfile_cache_miss_bytes":40925368,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":13442,"dirs.run_cpu_time_us":128,"dirs.run_wall_time_us":673,"drs_written":1,"lbm_read_time_us":21303,"lbm_reads_lt_1ms":713,"lbm_write_time_us":31746,"lbm_writes_lt_1ms":693,"num_input_rowsets":2,"peak_mem_usage":9186003,"rows_written":570100,"spinlock_wait_cycles":7040,"thread_start_us":360,"threads_started":6}
I20260615 08:09:04.882663 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:09:04.920385 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.036s user 0.017s sys 0.007s Metrics: {"bytes_written":519892,"cfile_init":1,"dirs.queue_time_us":33,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":5364,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":41,"peak_mem_usage":0,"rows_written":18250}
I20260615 08:09:04.920578 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 6646055 bytes on disk
I20260615 08:09:04.920789 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":36,"lbm_reads_lt_1ms":8}
I20260615 08:09:04.920909 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.008678
I20260615 08:09:05.335731 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 1.273s user 0.603s sys 0.054s Metrics: {"bytes_written":15730807,"cfile_cache_hit":14,"cfile_cache_hit_bytes":1074632,"cfile_cache_miss":688,"cfile_cache_miss_bytes":40450964,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":26507,"dirs.run_cpu_time_us":102,"dirs.run_wall_time_us":488,"drs_written":1,"lbm_read_time_us":52340,"lbm_reads_1-10_ms":8,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":707,"lbm_write_time_us":45563,"lbm_writes_1-10_ms":5,"lbm_writes_lt_1ms":683,"num_input_rowsets":2,"peak_mem_usage":9113762,"rows_written":566150,"spinlock_wait_cycles":5504,"thread_start_us":81,"threads_started":1}
I20260615 08:09:05.335896 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 6426164 bytes on disk
I20260615 08:09:05.339310 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:09:05.339583 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=3.921653
I20260615 08:09:05.477523 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.138s user 0.048s sys 0.002s Metrics: {"bytes_written":1182323,"cfile_init":1,"dirs.queue_time_us":35,"dirs.run_cpu_time_us":111,"dirs.run_wall_time_us":1761,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":5157,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":68,"peak_mem_usage":0,"rows_written":41650}
I20260615 08:09:05.478319 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1062438 bytes of WAL
I20260615 08:09:05.478461 14623 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:09:05.478567 14623 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000020 (ops 11153-11737)
I20260615 08:09:05.479625 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:05.479763 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.008618
I20260615 08:09:06.009989 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 1.277s user 0.644s sys 0.055s Metrics: {"bytes_written":16176081,"cfile_cache_hit":18,"cfile_cache_hit_bytes":1553132,"cfile_cache_miss":702,"cfile_cache_miss_bytes":41166908,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":9765,"dirs.run_cpu_time_us":111,"dirs.run_wall_time_us":1133,"drs_written":1,"lbm_read_time_us":29989,"lbm_reads_1-10_ms":4,"lbm_reads_lt_1ms":718,"lbm_write_time_us":52644,"lbm_writes_1-10_ms":4,"lbm_writes_lt_1ms":703,"num_input_rowsets":2,"peak_mem_usage":9378695,"rows_written":582350,"spinlock_wait_cycles":45824,"thread_start_us":271,"threads_started":6}
I20260615 08:09:06.010401 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=4.913840
I20260615 08:09:06.080205 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.070s user 0.052s sys 0.004s Metrics: {"bytes_written":1346020,"cfile_init":1,"dirs.queue_time_us":23,"dirs.run_cpu_time_us":112,"dirs.run_wall_time_us":610,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3977,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":74,"peak_mem_usage":0,"rows_written":47650}
I20260615 08:09:06.080528 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1050790 bytes of WAL
I20260615 08:09:06.080711 14547 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:09:06.080798 14547 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000020 (ops 11608-12209)
I20260615 08:09:06.081246 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:06.081378 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 7095179 bytes on disk
I20260615 08:09:06.081593 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":35,"lbm_reads_lt_1ms":8}
I20260615 08:09:06.081754 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.008386
I20260615 08:09:06.227082 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 1.306s user 0.619s sys 0.113s Metrics: {"bytes_written":16343221,"cfile_cache_hit":21,"cfile_cache_hit_bytes":2151521,"cfile_cache_miss":707,"cfile_cache_miss_bytes":41009495,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":12311,"dirs.run_cpu_time_us":102,"dirs.run_wall_time_us":1478,"drs_written":1,"lbm_read_time_us":30512,"lbm_reads_1-10_ms":4,"lbm_reads_lt_1ms":723,"lbm_write_time_us":62450,"lbm_writes_1-10_ms":7,"lbm_writes_lt_1ms":707,"num_input_rowsets":2,"peak_mem_usage":9480344,"rows_written":588350,"spinlock_wait_cycles":751872,"thread_start_us":275,"threads_started":6}
I20260615 08:09:06.227404 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=4.913840
I20260615 08:09:06.309921 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.082s user 0.052s sys 0.004s Metrics: {"bytes_written":1369767,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":110,"dirs.run_wall_time_us":614,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3821,"lbm_writes_lt_1ms":76,"peak_mem_usage":0,"rows_written":48400}
I20260615 08:09:06.310228 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 2114972 bytes of WAL
I20260615 08:09:06.310319 14698 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 2 log segments from log reader
I20260615 08:09:06.310367 14698 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000019 (ops 11198-11826)
I20260615 08:09:06.310622 14698 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000020 (ops 11827-12460)
I20260615 08:09:06.311473 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.001s sys 0.000s Metrics: {}
I20260615 08:09:06.311619 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.008314
I20260615 08:09:06.492633 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 1.013s user 0.602s sys 0.054s Metrics: {"bytes_written":16878203,"cfile_cache_hit":17,"cfile_cache_hit_bytes":1590799,"cfile_cache_miss":731,"cfile_cache_miss_bytes":42975055,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":152,"dirs.run_cpu_time_us":153,"dirs.run_wall_time_us":739,"drs_written":1,"lbm_read_time_us":26523,"lbm_reads_1-10_ms":3,"lbm_reads_lt_1ms":752,"lbm_write_time_us":50542,"lbm_writes_1-10_ms":4,"lbm_writes_lt_1ms":734,"num_input_rowsets":2,"peak_mem_usage":9771314,"rows_written":607800,"spinlock_wait_cycles":1536,"thread_start_us":304,"threads_started":6}
I20260615 08:09:06.492978 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 6907846 bytes on disk
I20260615 08:09:06.493219 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:09:06.493394 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=2.929465
I20260615 08:09:06.521747 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.028s user 0.027s sys 0.000s Metrics: {"bytes_written":1002012,"cfile_init":1,"dirs.queue_time_us":18,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1461,"lbm_writes_lt_1ms":61,"peak_mem_usage":0,"rows_written":35350}
I20260615 08:09:06.522029 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1073423 bytes of WAL
I20260615 08:09:06.522188 14623 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:09:06.522279 14623 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000021 (ops 11738-12328)
I20260615 08:09:06.522735 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:06.522881 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 345679 bytes on disk
I20260615 08:09:06.523066 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":22,"lbm_reads_lt_1ms":4}
I20260615 08:09:06.523208 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.008235
I20260615 08:09:06.882917 15226 raft_consensus.cc:993] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968: : Instructing follower d2ef54160cb2471ea1d740709d6446b7 to start an election
I20260615 08:09:06.883000 15226 raft_consensus.cc:1081] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968 [term 1 LEADER]: Signalling peer d2ef54160cb2471ea1d740709d6446b7 to start an election
I20260615 08:09:06.883316 14579 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2aee5f7f624a45c0be14bc719f978693"
dest_uuid: "d2ef54160cb2471ea1d740709d6446b7"
from {username='slave'} at 127.0.0.1:55684
I20260615 08:09:06.883389 14579 raft_consensus.cc:493] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260615 08:09:06.883415 14579 raft_consensus.cc:3060] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7 [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:09:06.884359 14579 raft_consensus.cc:515] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3526be60373413cbbfba3ff5de65968" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38477 } } peers { permanent_uuid: "ccd348dbed854f12940183b7be1966c4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43783 } } peers { permanent_uuid: "d2ef54160cb2471ea1d740709d6446b7" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 38913 } }
I20260615 08:09:06.884547 14579 leader_election.cc:290] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7 [CANDIDATE]: Term 2 election: Requested vote from peers a3526be60373413cbbfba3ff5de65968 (127.4.42.194:38477), ccd348dbed854f12940183b7be1966c4 (127.4.42.195:43783)
I20260615 08:09:06.889880 14656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aee5f7f624a45c0be14bc719f978693" candidate_uuid: "d2ef54160cb2471ea1d740709d6446b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 12864 } } ignore_live_leader: true dest_uuid: "a3526be60373413cbbfba3ff5de65968"
I20260615 08:09:06.889969 14656 raft_consensus.cc:3055] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968 [term 1 LEADER]: Stepping down as leader of term 1
I20260615 08:09:06.889995 14656 raft_consensus.cc:740] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a3526be60373413cbbfba3ff5de65968, State: Running, Role: LEADER
I20260615 08:09:06.890056 14656 consensus_queue.cc:260] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12864, Committed index: 12864, Last appended: 1.12864, Last appended by leader: 12864, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3526be60373413cbbfba3ff5de65968" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38477 } } peers { permanent_uuid: "ccd348dbed854f12940183b7be1966c4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43783 } } peers { permanent_uuid: "d2ef54160cb2471ea1d740709d6446b7" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 38913 } }
I20260615 08:09:06.890134 14656 raft_consensus.cc:3060] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968 [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:09:06.891000 14656 raft_consensus.cc:2468] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2ef54160cb2471ea1d740709d6446b7 in term 2.
I20260615 08:09:06.891170 14544 leader_election.cc:304] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a3526be60373413cbbfba3ff5de65968, d2ef54160cb2471ea1d740709d6446b7; no voters:
I20260615 08:09:06.891857 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.810s user 0.676s sys 0.044s Metrics: {"bytes_written":17489879,"cfile_cache_hit":21,"cfile_cache_hit_bytes":2230519,"cfile_cache_miss":753,"cfile_cache_miss_bytes":43962393,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":138,"dirs.run_cpu_time_us":131,"dirs.run_wall_time_us":668,"drs_written":1,"lbm_read_time_us":22692,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":772,"lbm_write_time_us":33531,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":763,"num_input_rowsets":2,"peak_mem_usage":10126030,"rows_written":630000,"thread_start_us":263,"threads_started":6}
I20260615 08:09:06.892362 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 7164028 bytes on disk
I20260615 08:09:06.892839 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:09:06.893031 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:09:06.894574 14731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2aee5f7f624a45c0be14bc719f978693" candidate_uuid: "d2ef54160cb2471ea1d740709d6446b7" candidate_term: 2 candidate_status { last_received { term: 1 index: 12864 } } ignore_live_leader: true dest_uuid: "ccd348dbed854f12940183b7be1966c4"
I20260615 08:09:06.894644 14731 raft_consensus.cc:3060] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4 [term 1 FOLLOWER]: Advancing to term 2
I20260615 08:09:06.895342 14731 raft_consensus.cc:2468] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2ef54160cb2471ea1d740709d6446b7 in term 2.
I20260615 08:09:06.897068 15254 raft_consensus.cc:2804] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7 [term 2 FOLLOWER]: Leader election won for term 2
I20260615 08:09:06.899521 15254 raft_consensus.cc:697] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7 [term 2 LEADER]: Becoming Leader. State: Replica: d2ef54160cb2471ea1d740709d6446b7, State: Running, Role: LEADER
I20260615 08:09:06.899626 15254 consensus_queue.cc:237] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12864, Committed index: 12864, Last appended: 1.12864, Last appended by leader: 12864, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3526be60373413cbbfba3ff5de65968" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38477 } } peers { permanent_uuid: "ccd348dbed854f12940183b7be1966c4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43783 } } peers { permanent_uuid: "d2ef54160cb2471ea1d740709d6446b7" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 38913 } }
I20260615 08:09:06.900332 14476 catalog_manager.cc:5696] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7 reported cstate change: term changed from 1 to 2, leader changed from a3526be60373413cbbfba3ff5de65968 (127.4.42.194) to d2ef54160cb2471ea1d740709d6446b7 (127.4.42.193). New cstate: current_term: 2 leader_uuid: "d2ef54160cb2471ea1d740709d6446b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3526be60373413cbbfba3ff5de65968" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccd348dbed854f12940183b7be1966c4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43783 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2ef54160cb2471ea1d740709d6446b7" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 38913 } health_report { overall_health: HEALTHY } } }
I20260615 08:09:06.907348 14731 raft_consensus.cc:1275] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4 [term 2 FOLLOWER]: Refusing update from remote peer d2ef54160cb2471ea1d740709d6446b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 12864. Preceding OpId from leader: term: 2 index: 12866. (index mismatch)
I20260615 08:09:06.907639 15260 consensus_queue.cc:1048] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd348dbed854f12940183b7be1966c4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12865, Last known committed idx: 12864, Time since last communication: 0.000s
I20260615 08:09:06.908360 14656 raft_consensus.cc:1275] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968 [term 2 FOLLOWER]: Refusing update from remote peer d2ef54160cb2471ea1d740709d6446b7: Log matching property violated. Preceding OpId in replica: term: 1 index: 12864. Preceding OpId from leader: term: 2 index: 12866. (index mismatch)
I20260615 08:09:06.908771 15254 consensus_queue.cc:1048] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3526be60373413cbbfba3ff5de65968" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12865, Last known committed idx: 12864, Time since last communication: 0.000s
I20260615 08:09:06.914539 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.020s user 0.014s sys 0.004s Metrics: {"bytes_written":378307,"cfile_init":1,"dirs.queue_time_us":24,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1407,"lbm_writes_lt_1ms":36,"peak_mem_usage":0,"rows_written":13150}
I20260615 08:09:06.914860 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1076394 bytes of WAL
I20260615 08:09:06.915031 14547 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:09:06.915643 14547 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000021 (ops 12210-12821)
I20260615 08:09:06.916200 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:06.916419 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 122585 bytes on disk
I20260615 08:09:06.916673 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":22,"lbm_reads_lt_1ms":4}
I20260615 08:09:06.917029 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.008161
I20260615 08:09:07.000331 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.477s user 0.434s sys 0.031s Metrics: {"bytes_written":17853515,"cfile_cache_hit":10,"cfile_cache_hit_bytes":532213,"cfile_cache_miss":782,"cfile_cache_miss_bytes":46627693,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":612,"dirs.run_cpu_time_us":1242,"dirs.run_wall_time_us":4492,"drs_written":1,"lbm_read_time_us":17933,"lbm_reads_lt_1ms":802,"lbm_write_time_us":22423,"lbm_writes_lt_1ms":779,"num_input_rowsets":2,"peak_mem_usage":10356964,"rows_written":643150}
I20260615 08:09:07.000680 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 7315539 bytes on disk
I20260615 08:09:07.000834 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20260615 08:09:07.002069 4267 test_workload.cc:405] TestWorkload: Skipping table creation because table test-workload already exists
I20260615 08:09:07.115491 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.804s user 0.674s sys 0.068s Metrics: {"bytes_written":17677817,"cfile_cache_hit":15,"cfile_cache_hit_bytes":1294698,"cfile_cache_miss":765,"cfile_cache_miss_bytes":45393930,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":8617,"dirs.run_cpu_time_us":106,"dirs.run_wall_time_us":683,"drs_written":1,"lbm_read_time_us":21717,"lbm_reads_lt_1ms":793,"lbm_write_time_us":31532,"lbm_writes_lt_1ms":772,"num_input_rowsets":2,"peak_mem_usage":10236612,"rows_written":636750,"spinlock_wait_cycles":1289344,"thread_start_us":73,"threads_started":1}
I20260615 08:09:07.115674 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:09:07.137740 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.022s user 0.014s sys 0.003s Metrics: {"bytes_written":286872,"cfile_init":1,"dirs.queue_time_us":683,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":673,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":10000}
I20260615 08:09:07.138000 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 7335214 bytes on disk
I20260615 08:09:07.138187 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":36,"lbm_reads_lt_1ms":8}
I20260615 08:09:07.138345 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.007938
I20260615 08:09:07.285573 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.000000
I20260615 08:09:07.301893 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.016s user 0.013s sys 0.000s Metrics: {"bytes_written":277779,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":141,"dirs.run_wall_time_us":902,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":660,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9650}
I20260615 08:09:07.302443 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1051666 bytes of WAL
I20260615 08:09:07.302583 14623 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:09:07.302711 14623 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000022 (ops 12329-12939)
I20260615 08:09:07.303210 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:07.303366 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.007918
I20260615 08:09:07.661955 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.745s user 0.687s sys 0.036s Metrics: {"bytes_written":17853515,"cfile_cache_hit":11,"cfile_cache_hit_bytes":674328,"cfile_cache_miss":783,"cfile_cache_miss_bytes":46527698,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":9758,"dirs.run_cpu_time_us":103,"dirs.run_wall_time_us":1750,"drs_written":1,"lbm_read_time_us":19882,"lbm_reads_lt_1ms":803,"lbm_write_time_us":32100,"lbm_writes_lt_1ms":779,"num_input_rowsets":2,"peak_mem_usage":10379183,"rows_written":643150,"spinlock_wait_cycles":1701760,"thread_start_us":248,"threads_started":6}
I20260615 08:09:07.662266 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.939805
I20260615 08:09:07.703449 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.041s user 0.026s sys 0.005s Metrics: {"bytes_written":590884,"cfile_init":1,"dirs.queue_time_us":20,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1487,"lbm_writes_lt_1ms":45,"peak_mem_usage":0,"rows_written":20650}
I20260615 08:09:07.703936 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 7514770 bytes on disk
I20260615 08:09:07.704233 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":47,"lbm_reads_lt_1ms":8}
I20260615 08:09:07.704610 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.007950
I20260615 08:09:07.906275 14466 maintenance_manager.cc:419] P 8441fd568a084c40a32d3b05578699b1: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.000728
I20260615 08:09:07.916468 14465 maintenance_manager.cc:643] P 8441fd568a084c40a32d3b05578699b1: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.010s user 0.001s sys 0.000s Metrics: {"bytes_written":426,"delete_count":0,"lbm_write_time_us":39,"lbm_writes_lt_1ms":4,"reinsert_count":0,"thread_start_us":51,"threads_started":1,"update_count":1,"wal-append.queue_time_us":9016}
I20260615 08:09:07.916625 14466 maintenance_manager.cc:419] P 8441fd568a084c40a32d3b05578699b1: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.195592
I20260615 08:09:07.918286 14465 maintenance_manager.cc:643] P 8441fd568a084c40a32d3b05578699b1: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.002s user 0.001s sys 0.000s Metrics: {"cfile_cache_miss":5,"cfile_cache_miss_bytes":2090,"cfile_init":3,"delete_count":0,"delta_blocks_compacted":1,"delta_iterators_relevant":1,"lbm_read_time_us":59,"lbm_reads_lt_1ms":17,"lbm_write_time_us":70,"lbm_writes_lt_1ms":9,"peak_mem_usage":33455,"reinsert_count":0,"thread_start_us":136,"threads_started":2,"update_count":1}
I20260615 08:09:08.031738 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.893s user 0.660s sys 0.074s Metrics: {"bytes_written":17954454,"cfile_cache_hit":13,"cfile_cache_hit_bytes":800446,"cfile_cache_miss":785,"cfile_cache_miss_bytes":46675286,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":13487,"dirs.run_cpu_time_us":135,"dirs.run_wall_time_us":982,"drs_written":1,"lbm_read_time_us":25993,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":803,"lbm_write_time_us":41928,"lbm_writes_1-10_ms":3,"lbm_writes_lt_1ms":780,"num_input_rowsets":2,"peak_mem_usage":10440839,"rows_written":646750,"spinlock_wait_cycles":9856,"thread_start_us":452,"threads_started":6}
I20260615 08:09:08.032136 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 7357569 bytes on disk
I20260615 08:09:08.032282 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:09:08.032431 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=2.929465
I20260615 08:09:08.086090 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.053s user 0.030s sys 0.004s Metrics: {"bytes_written":823145,"cfile_init":1,"dirs.queue_time_us":24,"dirs.run_cpu_time_us":89,"dirs.run_wall_time_us":514,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1673,"lbm_writes_lt_1ms":54,"peak_mem_usage":0,"rows_written":29000}
I20260615 08:09:08.086359 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1056394 bytes of WAL
I20260615 08:09:08.087459 14698 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:09:08.087568 14698 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000021 (ops 12461-13135)
I20260615 08:09:08.088150 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:08.088294 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.007827
I20260615 08:09:08.305611 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 1.002s user 0.692s sys 0.055s Metrics: {"bytes_written":18116592,"cfile_cache_hit":14,"cfile_cache_hit_bytes":947138,"cfile_cache_miss":790,"cfile_cache_miss_bytes":46967380,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":341,"dirs.run_cpu_time_us":129,"dirs.run_wall_time_us":11742,"drs_written":1,"lbm_read_time_us":28152,"lbm_reads_1-10_ms":4,"lbm_reads_lt_1ms":810,"lbm_write_time_us":51898,"lbm_writes_1-10_ms":9,"lbm_writes_lt_1ms":781,"num_input_rowsets":2,"peak_mem_usage":10536191,"rows_written":652800,"spinlock_wait_cycles":11008,"thread_start_us":349,"threads_started":6}
I20260615 08:09:08.305894 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 7427798 bytes on disk
I20260615 08:09:08.306052 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:09:08.306171 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=2.929465
I20260615 08:09:08.376837 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.071s user 0.033s sys 0.007s Metrics: {"bytes_written":903191,"cfile_init":1,"dirs.queue_time_us":26,"dirs.run_cpu_time_us":121,"dirs.run_wall_time_us":531,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":4459,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":56,"peak_mem_usage":0,"rows_written":31850}
I20260615 08:09:08.377101 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1055269 bytes of WAL
I20260615 08:09:08.377252 14623 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:09:08.377305 14623 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000023 (ops 12940-13591)
I20260615 08:09:08.377702 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:08.377835 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 312231 bytes on disk
I20260615 08:09:08.378049 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4}
I20260615 08:09:08.378654 14683 maintenance_manager.cc:419] P a3526be60373413cbbfba3ff5de65968: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.007752
I20260615 08:09:08.635527 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.931s user 0.660s sys 0.101s Metrics: {"bytes_written":18424455,"cfile_cache_hit":13,"cfile_cache_hit_bytes":904778,"cfile_cache_miss":803,"cfile_cache_miss_bytes":47798878,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":14499,"dirs.run_cpu_time_us":130,"dirs.run_wall_time_us":798,"drs_written":1,"lbm_read_time_us":25593,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":822,"lbm_write_time_us":42601,"lbm_writes_1-10_ms":5,"lbm_writes_lt_1ms":799,"num_input_rowsets":2,"peak_mem_usage":10703921,"rows_written":663800,"spinlock_wait_cycles":11264,"thread_start_us":55,"threads_started":1}
I20260615 08:09:08.636301 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 7554673 bytes on disk
I20260615 08:09:08.636497 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:09:08.636854 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=2.929465
I20260615 08:09:08.682369 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.045s user 0.027s sys 0.008s Metrics: {"bytes_written":862459,"cfile_init":1,"dirs.queue_time_us":141,"dirs.run_cpu_time_us":102,"dirs.run_wall_time_us":1360,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1701,"lbm_writes_lt_1ms":56,"peak_mem_usage":0,"rows_written":30400,"spinlock_wait_cycles":2304}
I20260615 08:09:08.682751 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1130119 bytes of WAL
I20260615 08:09:08.682971 14547 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:09:08.683055 14547 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000022 (ops 12822-13476)
I20260615 08:09:08.683501 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:08.684121 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.007575
I20260615 08:09:08.690640 4267 tablet_server.cc:179] TabletServer@127.4.42.194:0 shutting down...
W20260615 08:09:08.694392 14544 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
W20260615 08:09:08.695837 14544 consensus_peers.cc:597] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7 -> Peer a3526be60373413cbbfba3ff5de65968 (127.4.42.194:38477): Couldn't send request to peer a3526be60373413cbbfba3ff5de65968. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260615 08:09:08.899922 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.812s user 0.716s sys 0.052s Metrics: {"bytes_written":18753176,"cfile_cache_hit":13,"cfile_cache_hit_bytes":927549,"cfile_cache_miss":817,"cfile_cache_miss_bytes":48649247,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":163,"dirs.run_cpu_time_us":134,"dirs.run_wall_time_us":634,"drs_written":1,"lbm_read_time_us":20979,"lbm_reads_lt_1ms":841,"lbm_write_time_us":35909,"lbm_writes_lt_1ms":818,"num_input_rowsets":2,"peak_mem_usage":10891386,"rows_written":675750,"spinlock_wait_cycles":384,"thread_start_us":261,"threads_started":6}
I20260615 08:09:08.900318 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.937278
I20260615 08:09:08.924556 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.024s user 0.023s sys 0.000s Metrics: {"bytes_written":556694,"cfile_init":1,"dirs.queue_time_us":38,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1207,"lbm_writes_lt_1ms":43,"peak_mem_usage":0,"rows_written":19500}
I20260615 08:09:08.924793 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling LogGCOp(2aee5f7f624a45c0be14bc719f978693): free 1056246 bytes of WAL
I20260615 08:09:08.924952 14698 log_reader.cc:385] T 2aee5f7f624a45c0be14bc719f978693: removed 1 log segments from log reader
I20260615 08:09:08.925026 14698 log.cc:1079] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2aee5f7f624a45c0be14bc719f978693/wal-000000022 (ops 13136-13785)
I20260615 08:09:08.925473 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: LogGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:08.925590 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.007559
I20260615 08:09:09.023851 14623 maintenance_manager.cc:643] P a3526be60373413cbbfba3ff5de65968: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.644s user 0.524s sys 0.047s Metrics: {"bytes_written":18995659,"cfile_cache_hit":13,"cfile_cache_hit_bytes":935146,"cfile_cache_miss":827,"cfile_cache_miss_bytes":49279176,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":383,"dirs.run_cpu_time_us":71,"dirs.run_wall_time_us":18138,"drs_written":1,"lbm_read_time_us":20505,"lbm_reads_lt_1ms":847,"lbm_write_time_us":33079,"lbm_writes_lt_1ms":829,"num_input_rowsets":2,"peak_mem_usage":11034796,"rows_written":684650,"spinlock_wait_cycles":2176,"thread_start_us":351,"threads_started":6}
I20260615 08:09:09.024338 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:09:09.024530 4267 tablet_replica.cc:333] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968: stopping tablet replica
I20260615 08:09:09.024598 4267 raft_consensus.cc:2243] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260615 08:09:09.024637 4267 pending_rounds.cc:70] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968: Trying to abort 1 pending ops.
I20260615 08:09:09.024654 4267 pending_rounds.cc:77] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968: Aborting op as it isn't in flight: id { term: 2 index: 13937 } timestamp: 7297068845823275008 op_type: WRITE_OP write_request { tablet_id: "2aee5f7f624a45c0be14bc719f978693" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "\001\007\000XOQW\350\357\221\376\000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\226\\qg\361q\261c\020\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\305 \315\000\336vQo \000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\251\222#7K\026>\2500\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000d\214B\027\251\021\034\030@\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\203\r\022!l\001\352\270P\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\306X\327A\330\213\004\344`\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\034\257\347c\231\\T\271p\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000_z\334f\265p:\222\200\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000K\277\2318\240\0068>\220\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000k\253\365\n\356\252\377v\240\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000$\372\370_\234c\307\250\260\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\355\334\nT\227\261s\035\300\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\211\006KR\036Mu\t\320\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\252\230yg\020\236\307A\340\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\321Lw=\035t\202\263\360\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\0002\001>r}hwG\000\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000(\234T\000\3112\203\204\020\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\276\354\3152\"\260\001I \001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000&\000+-{\2708I0\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\'.;][\270\010>@\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000le\256R\375 PlP\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\366>g\006\004\241\361m`\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\261\261$+\016-p\215p\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000@\263\002bM\237\213\305\200\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\342\037\2216\200\257\361\r\220\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\276n\035x:\003m\301\240\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\262l\237O\\\330\372\032\260\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000]`\007l\254\203\272\312\300\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\324\355\222R\372}H \320\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\351\273\352L\263\303qF\340\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000h\"u?C\315Y\022\360\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\301\366\356\"#\\\314\340\000\002\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\272\370\350_\333\357\305\252\020\002\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\272\036\256b}\375W\265 \002\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000M\213;RQ\250\31440\002\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\227\233\341s&\325\033D@\002\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\325\244\017\004%/\251xP\002\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\226\"\373P\260xL\366`\002\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000]\254\321U)-x\274p\002\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\202\222_F\343\032\030\t\200\002\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\322B\301O\341\037\035d\220\002\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\337b\373;3j\\\n\240\002\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\214\201 8.\255]\306\260\002\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\032\354\2505\035\025O\316\300\002\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000|\341\2054\360\001\260\013\320\002\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\t\227\355e\202\204\321\'\340\002\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\263\3756x\204v\261\364\360\002\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000:%F\033\026\232\212\323\000\003\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\334\r@\003mV\306h\020\003\000\000\000\000\000\000\020\000\000\000\000\000\000\000""\001\007\000XOQW\350\357\221\376\000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\226\\qg\361q\261c\020\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\305 \315\000\336vQo \000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\251\222#7K\026>\2500\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000d\214B\027\251\021\034\030@\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\203\r\022!l\001\352\270P\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\306X\327A\330\213\004\344`\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\034\257\347c\231\\T\271p\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000_z\334f\265p:\222\200\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000K\277\2318\240\0068>\220\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000k\253\365\n\356\252\377v\240\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000$\372\370_\234c\307\250\260\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\355\334\nT\227\261s\035\300\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\211\006KR\036Mu\t\320\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\252\230yg\020\236\307A\340\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\321Lw=\035t\202\263\360\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\0002\001>r}hwG\000\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000(\234T\000\3112\203\204\020\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\276\354\3152\"\260\001I \001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000&\000+-{\2708I0\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\'.;][\270\010>@\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000le\256R\375 PlP\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\366>g\006\004\241\361m`\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\261\261$+\016-p\215p\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000@\263\002bM\237\213\305\200\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\342\037\2216\200\257\361\r\220\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\276n\035x:\003m\301\240\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\262l\237O\\\330\372\032\260\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000]`\007l\254\203\272\312\300\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\324\355\222R\372}H \320\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\351\273\352L\263\303qF\340\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000h\"u?C\315Y\022\360\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\301\366\356\"#\\\314\340\000\002\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\272\370\350_\333\357\305\252\020\002\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\272\036\256b}\375W\265 \002\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000M\213;RQ\250\31440\002\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\227\233\341s&\325\033D@\002\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\325\244\017\004%/\251xP\002\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\226\"\373P\260xL\366`\002\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000]\254\321U)-x\274p\002\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\202\222_F\343\032\030\t\200\002\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\322B\301O\341\037\035d\220\002\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\337b\373;3j\\\n\240\002\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\214\201 8.\255]\306\260\002\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\032\354\2505\035\025O\316\300\002\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000|\341\2054\360\001\260\013\320\002\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\t\227\355e\202\204\321\'\340\002\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\263\3756x\204v\261\364\360\002\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000:%F\033\026\232\212\323\000\003\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\334\r@\003mV\306h\020\003\000\000\000\000\000\000\020\000\000\000\000\000\000\000" indirect_data: "aa29bed5355f4f263537f358d892a50ec66bd8a7a4b9c01fa5be8bdc81a09967b26f632addaf2a2fc8312824a684f10651d746bd98ca988a4a6b2a868369d32bb820764a366c221feb16cfe2cd546ab6a3027ad4ef9c4e284d05a538db444e122c20132b5b95055da99c71acbbd612be68613c6c0f8bd654399132d1573ea9bbc37d1ca415c6a98c3ed1267f2a6cf8228142753be43d2beb1c5296b36447a0975a1a8aed892df7a48852d6126cc878059360d9bf76ef29124e240cc5c185032e0f06216db6f94746cc8f61f6b2d1097d12b92731f37858c92dcf84baa6260f51bb83a7cf00fc4b1f22022a14f83172a1f42af44e601a8f47f3bbad28cccab0e8d7a01c5a214ac9a8e9b05fe2f4ce494672631e04128f64e86eba60e21c5d5acb419bdea8406dd0d6da606e1261b4da8a1202858cc71ba8c8ffcc0400d635bb18185e7cc646a36f538df297cc6397b276d487364871f976fed290f77c56cfeed311e3329bb61f103ac0a5e16994e3ab4f6f1603c89ca4f0e438cdfbc13696b21322e2981514dd392f97991aa109469843""aa29bed5355f4f263537f358d892a50ec66bd8a7a4b9c01fa5be8bdc81a09967b26f632addaf2a2fc8312824a684f10651d746bd98ca988a4a6b2a868369d32bb820764a366c221feb16cfe2cd546ab6a3027ad4ef9c4e284d05a538db444e122c20132b5b95055da99c71acbbd612be68613c6c0f8bd654399132d1573ea9bbc37d1ca415c6a98c3ed1267f2a6cf8228142753be43d2beb1c5296b36447a0975a1a8aed892df7a48852d6126cc878059360d9bf76ef29124e240cc5c185032e0f06216db6f94746cc8f61f6b2d1097d12b92731f37858c92dcf84baa6260f51bb83a7cf00fc4b1f22022a14f83172a1f42af44e601a8f47f3bbad28cccab0e8d7a01c5a214ac9a8e9b05fe2f4ce494672631e04128f64e86eba60e21c5d5acb419bdea8406dd0d6da606e1261b4da8a1202858cc71ba8c8ffcc0400d635bb18185e7cc646a36f538df297cc6397b276d487364871f976fed290f77c56cfeed311e3329bb61f103ac0a5e16994e3ab4f6f1603c89ca4f0e438cdfbc13696b21322e2981514dd392f97991aa109469843" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7297068845781319680 authz_token { token_data: "\010\317\350\276\321\006\"3\n\005slave\022*\n 292eebff7d1e4a47bf95a6c7b795713f\020\001\030\001 \001(\001" signature: "u\337\204\366\315\302\320\353(\330$\254m\t z\242\\\362\212\242{s}F\205\362\006\361\255\234\000u\203Q_4\3065\261Z\007Q\302\267$\033\022\266\241\325\212E\355\2330\177\326\213\347v\177\325?""u\337\204\366\315\302\320\353(\330$\254m\t z\242\\\362\212\242{s}F\205\362\006\361\255\234\000u\203Q_4\3065\261Z\007Q\302\267$\033\022\266\241\325\212E\355\2330\177\326\213\347v\177\325?" signing_key_seq_num: 0 } } request_id { client_id: "ecaee17f6ed448df861de5a403360140" seq_no: 1041 first_incomplete_seq_no: 1038 attempt_no: 0 }
I20260615 08:09:09.024948 4267 raft_consensus.cc:2272] T 2aee5f7f624a45c0be14bc719f978693 P a3526be60373413cbbfba3ff5de65968 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:09:09.039058 4267 tablet_server.cc:196] TabletServer@127.4.42.194:0 shutdown complete.
I20260615 08:09:09.071740 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:09:09.072999 15378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:09:09.073110 15381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:09:09.073211 15379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:09:09.073331 4267 server_base.cc:1061] running on GCE node
I20260615 08:09:09.073516 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:09:09.073572 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:09:09.073601 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510949073601 us; error 0 us; skew 500 ppm
I20260615 08:09:09.074301 4267 webserver.cc:533] Webserver started at http://127.4.42.196:40957/ using document root <none> and password file <none>
I20260615 08:09:09.074384 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:09:09.074429 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:09:09.074501 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:09:09.074772 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-3-root/instance:
uuid: "1c45912f4aaf4a8083d01283f93c255e"
format_stamp: "Formatted at 2026-06-15 08:09:09 on dist-test-slave-37n8"
I20260615 08:09:09.075657 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:09:09.076154 15386 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:09:09.076306 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:09:09.076354 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-3-root
uuid: "1c45912f4aaf4a8083d01283f93c255e"
format_stamp: "Formatted at 2026-06-15 08:09:09 on dist-test-slave-37n8"
I20260615 08:09:09.076401 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_0.1781510637089012-4267-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:09:09.094229 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:09:09.094421 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:09:09.094617 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:09:09.094841 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:09:09.094889 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:09:09.094957 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:09:09.094990 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:09:09.098335 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.196:38813
I20260615 08:09:09.100454 15449 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.196:38813 every 8 connection(s)
I20260615 08:09:09.103962 15450 heartbeater.cc:344] Connected to a master server at 127.4.42.254:41635
I20260615 08:09:09.104025 15450 heartbeater.cc:461] Registering TS with master...
I20260615 08:09:09.104127 15450 heartbeater.cc:507] Master 127.4.42.254:41635 requested a full tablet report, sending...
I20260615 08:09:09.104334 14476 ts_manager.cc:194] Registered new tserver with Master: 1c45912f4aaf4a8083d01283f93c255e (127.4.42.196:38813)
I20260615 08:09:09.104712 14476 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44098
I20260615 08:09:09.333688 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.649s user 0.555s sys 0.087s Metrics: {"bytes_written":19255329,"cfile_cache_hit":10,"cfile_cache_hit_bytes":532834,"cfile_cache_miss":844,"cfile_cache_miss_bytes":50388548,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":361,"dirs.run_cpu_time_us":151,"dirs.run_wall_time_us":592,"drs_written":1,"lbm_read_time_us":20368,"lbm_reads_lt_1ms":868,"lbm_write_time_us":34711,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":838,"num_input_rowsets":2,"peak_mem_usage":11193076,"rows_written":694200,"thread_start_us":333,"threads_started":6}
I20260615 08:09:09.334112 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 7907008 bytes on disk
I20260615 08:09:09.337018 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20260615 08:09:09.464820 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.539s user 0.487s sys 0.048s Metrics: {"bytes_written":19286603,"cfile_cache_hit":10,"cfile_cache_hit_bytes":532887,"cfile_cache_miss":844,"cfile_cache_miss_bytes":50483523,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":174,"dirs.run_cpu_time_us":123,"dirs.run_wall_time_us":6806,"drs_written":1,"lbm_read_time_us":18178,"lbm_reads_lt_1ms":872,"lbm_write_time_us":30285,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":839,"num_input_rowsets":2,"peak_mem_usage":11217752,"rows_written":695250,"thread_start_us":178,"threads_started":5}
I20260615 08:09:09.465044 14758 maintenance_manager.cc:419] P ccd348dbed854f12940183b7be1966c4: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 7919173 bytes on disk
I20260615 08:09:09.465173 14698 maintenance_manager.cc:643] P ccd348dbed854f12940183b7be1966c4: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:09:09.691593 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling FlushMRSOp(2aee5f7f624a45c0be14bc719f978693): perf score=0.121360
I20260615 08:09:09.693886 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: FlushMRSOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.002s user 0.001s sys 0.000s Metrics: {"bytes_written":31861,"cfile_init":1,"dirs.queue_time_us":39,"dirs.run_cpu_time_us":102,"dirs.run_wall_time_us":678,"drs_written":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4,"lbm_write_time_us":208,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1050}
I20260615 08:09:09.694092 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 9111 bytes on disk
I20260615 08:09:09.694262 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":22,"lbm_reads_lt_1ms":4}
I20260615 08:09:09.694399 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693): perf score=1.005407
I20260615 08:09:10.098423 15454 consensus_queue.cc:579] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7 [LEADER]: Leader has been unable to successfully communicate with peer a3526be60373413cbbfba3ff5de65968 for more than 1 seconds (1.403s)
I20260615 08:09:10.099670 14579 consensus_queue.cc:237] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13937, Committed index: 13937, Last appended: 2.13937, Last appended by leader: 12864, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13938 OBSOLETE_local: false peers { permanent_uuid: "a3526be60373413cbbfba3ff5de65968" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38477 } } peers { permanent_uuid: "ccd348dbed854f12940183b7be1966c4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43783 } } peers { permanent_uuid: "d2ef54160cb2471ea1d740709d6446b7" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 38913 } } peers { permanent_uuid: "1c45912f4aaf4a8083d01283f93c255e" member_type: NON_VOTER last_known_addr { host: "127.4.42.196" port: 38813 } attrs { promote: true } }
W20260615 08:09:10.100903 14544 consensus_peers.cc:597] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7 -> Peer a3526be60373413cbbfba3ff5de65968 (127.4.42.194:38477): Couldn't send request to peer a3526be60373413cbbfba3ff5de65968. Status: Network error: Client connection negotiation failed: client connection to 127.4.42.194:38477: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260615 08:09:10.100986 14731 raft_consensus.cc:1275] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4 [term 2 FOLLOWER]: Refusing update from remote peer d2ef54160cb2471ea1d740709d6446b7: Log matching property violated. Preceding OpId in replica: term: 2 index: 13937. Preceding OpId from leader: term: 2 index: 13938. (index mismatch)
I20260615 08:09:10.101245 15469 consensus_queue.cc:1048] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccd348dbed854f12940183b7be1966c4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13938, Last known committed idx: 13937, Time since last communication: 0.000s
I20260615 08:09:10.101879 15468 raft_consensus.cc:2955] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7 [term 2 LEADER]: Committing config change with OpId 2.13938: config changed from index -1 to 13938, NON_VOTER 1c45912f4aaf4a8083d01283f93c255e (127.4.42.196) added. New config: { opid_index: 13938 OBSOLETE_local: false peers { permanent_uuid: "a3526be60373413cbbfba3ff5de65968" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38477 } } peers { permanent_uuid: "ccd348dbed854f12940183b7be1966c4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43783 } } peers { permanent_uuid: "d2ef54160cb2471ea1d740709d6446b7" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 38913 } } peers { permanent_uuid: "1c45912f4aaf4a8083d01283f93c255e" member_type: NON_VOTER last_known_addr { host: "127.4.42.196" port: 38813 } attrs { promote: true } } }
I20260615 08:09:10.103075 14463 catalog_manager.cc:5209] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 2aee5f7f624a45c0be14bc719f978693 with cas_config_opid_index -1: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20260615 08:09:10.103264 14476 catalog_manager.cc:5696] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7 reported cstate change: config changed from index -1 to 13938, NON_VOTER 1c45912f4aaf4a8083d01283f93c255e (127.4.42.196) added. New cstate: current_term: 2 leader_uuid: "d2ef54160cb2471ea1d740709d6446b7" committed_config { opid_index: 13938 OBSOLETE_local: false peers { permanent_uuid: "a3526be60373413cbbfba3ff5de65968" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccd348dbed854f12940183b7be1966c4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43783 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2ef54160cb2471ea1d740709d6446b7" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 38913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c45912f4aaf4a8083d01283f93c255e" member_type: NON_VOTER last_known_addr { host: "127.4.42.196" port: 38813 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260615 08:09:10.103529 14731 raft_consensus.cc:2955] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4 [term 2 FOLLOWER]: Committing config change with OpId 2.13938: config changed from index -1 to 13938, NON_VOTER 1c45912f4aaf4a8083d01283f93c255e (127.4.42.196) added. New config: { opid_index: 13938 OBSOLETE_local: false peers { permanent_uuid: "a3526be60373413cbbfba3ff5de65968" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38477 } } peers { permanent_uuid: "ccd348dbed854f12940183b7be1966c4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43783 } } peers { permanent_uuid: "d2ef54160cb2471ea1d740709d6446b7" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 38913 } } peers { permanent_uuid: "1c45912f4aaf4a8083d01283f93c255e" member_type: NON_VOTER last_known_addr { host: "127.4.42.196" port: 38813 } attrs { promote: true } } }
W20260615 08:09:10.104993 14544 consensus_peers.cc:597] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7 -> Peer 1c45912f4aaf4a8083d01283f93c255e (127.4.42.196:38813): Couldn't send request to peer 1c45912f4aaf4a8083d01283f93c255e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2aee5f7f624a45c0be14bc719f978693. This is attempt 1: this message will repeat every 5th retry.
I20260615 08:09:10.105224 15450 heartbeater.cc:499] Master 127.4.42.254:41635 was elected leader, sending a full tablet report...
I20260615 08:09:10.122542 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: CompactRowSetsOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.428s user 0.396s sys 0.032s Metrics: {"bytes_written":19286603,"cfile_cache_hit":10,"cfile_cache_hit_bytes":289915,"cfile_cache_miss":850,"cfile_cache_miss_bytes":50761959,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":317,"dirs.run_cpu_time_us":107,"dirs.run_wall_time_us":944,"drs_written":1,"lbm_read_time_us":16039,"lbm_reads_lt_1ms":870,"lbm_write_time_us":23590,"lbm_writes_lt_1ms":841,"num_input_rowsets":2,"peak_mem_usage":11235242,"rows_written":695250,"thread_start_us":310,"threads_started":5}
I20260615 08:09:10.122831 14607 maintenance_manager.cc:419] P d2ef54160cb2471ea1d740709d6446b7: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 7919173 bytes on disk
I20260615 08:09:10.123206 14547 maintenance_manager.cc:643] P d2ef54160cb2471ea1d740709d6446b7: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20260615 08:09:10.536815 15485 ts_tablet_manager.cc:933] T 2aee5f7f624a45c0be14bc719f978693 P 1c45912f4aaf4a8083d01283f93c255e: Initiating tablet copy from peer d2ef54160cb2471ea1d740709d6446b7 (127.4.42.193:38913)
I20260615 08:09:10.537070 15485 tablet_copy_client.cc:323] T 2aee5f7f624a45c0be14bc719f978693 P 1c45912f4aaf4a8083d01283f93c255e: tablet copy: Beginning tablet copy session from remote peer at address 127.4.42.193:38913
I20260615 08:09:10.539872 14590 tablet_copy_service.cc:140] P d2ef54160cb2471ea1d740709d6446b7: Received BeginTabletCopySession request for tablet 2aee5f7f624a45c0be14bc719f978693 from peer 1c45912f4aaf4a8083d01283f93c255e ({username='slave'} at 127.0.0.1:47592)
I20260615 08:09:10.539932 14590 tablet_copy_service.cc:161] P d2ef54160cb2471ea1d740709d6446b7: Beginning new tablet copy session on tablet 2aee5f7f624a45c0be14bc719f978693 from peer 1c45912f4aaf4a8083d01283f93c255e at {username='slave'} at 127.0.0.1:47592: session id = 1c45912f4aaf4a8083d01283f93c255e-2aee5f7f624a45c0be14bc719f978693
I20260615 08:09:10.540526 14590 tablet_copy_source_session.cc:215] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7: Tablet Copy: opened 5 blocks and 1 log segments
I20260615 08:09:10.540915 15485 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2aee5f7f624a45c0be14bc719f978693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:09:10.541960 15485 tablet_copy_client.cc:806] T 2aee5f7f624a45c0be14bc719f978693 P 1c45912f4aaf4a8083d01283f93c255e: tablet copy: Starting download of 5 data blocks...
I20260615 08:09:10.597669 15485 tablet_copy_client.cc:670] T 2aee5f7f624a45c0be14bc719f978693 P 1c45912f4aaf4a8083d01283f93c255e: tablet copy: Starting download of 1 WAL segments...
I20260615 08:09:10.599941 15485 tablet_copy_client.cc:538] T 2aee5f7f624a45c0be14bc719f978693 P 1c45912f4aaf4a8083d01283f93c255e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260615 08:09:10.600703 15485 tablet_bootstrap.cc:492] T 2aee5f7f624a45c0be14bc719f978693 P 1c45912f4aaf4a8083d01283f93c255e: Bootstrap starting.
I20260615 08:09:10.659279 15485 tablet_bootstrap.cc:492] T 2aee5f7f624a45c0be14bc719f978693 P 1c45912f4aaf4a8083d01283f93c255e: Bootstrap replayed 1/1 log segments. Stats: ops{read=462 overwritten=0 applied=462 ignored=461} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=3. Pending: 0 replicates
I20260615 08:09:10.659651 15485 tablet_bootstrap.cc:492] T 2aee5f7f624a45c0be14bc719f978693 P 1c45912f4aaf4a8083d01283f93c255e: Bootstrap complete.
I20260615 08:09:10.659996 15485 ts_tablet_manager.cc:1403] T 2aee5f7f624a45c0be14bc719f978693 P 1c45912f4aaf4a8083d01283f93c255e: Time spent bootstrapping tablet: real 0.059s user 0.054s sys 0.004s
I20260615 08:09:10.660156 15485 raft_consensus.cc:359] T 2aee5f7f624a45c0be14bc719f978693 P 1c45912f4aaf4a8083d01283f93c255e [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13938 OBSOLETE_local: false peers { permanent_uuid: "a3526be60373413cbbfba3ff5de65968" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38477 } } peers { permanent_uuid: "ccd348dbed854f12940183b7be1966c4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43783 } } peers { permanent_uuid: "d2ef54160cb2471ea1d740709d6446b7" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 38913 } } peers { permanent_uuid: "1c45912f4aaf4a8083d01283f93c255e" member_type: NON_VOTER last_known_addr { host: "127.4.42.196" port: 38813 } attrs { promote: true } }
I20260615 08:09:10.660230 15485 raft_consensus.cc:740] T 2aee5f7f624a45c0be14bc719f978693 P 1c45912f4aaf4a8083d01283f93c255e [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 1c45912f4aaf4a8083d01283f93c255e, State: Initialized, Role: LEARNER
I20260615 08:09:10.660272 15485 consensus_queue.cc:260] T 2aee5f7f624a45c0be14bc719f978693 P 1c45912f4aaf4a8083d01283f93c255e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13938, Last appended: 2.13938, Last appended by leader: 13938, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13938 OBSOLETE_local: false peers { permanent_uuid: "a3526be60373413cbbfba3ff5de65968" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 38477 } } peers { permanent_uuid: "ccd348dbed854f12940183b7be1966c4" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 43783 } } peers { permanent_uuid: "d2ef54160cb2471ea1d740709d6446b7" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 38913 } } peers { permanent_uuid: "1c45912f4aaf4a8083d01283f93c255e" member_type: NON_VOTER last_known_addr { host: "127.4.42.196" port: 38813 } attrs { promote: true } }
I20260615 08:09:10.660414 15485 ts_tablet_manager.cc:1434] T 2aee5f7f624a45c0be14bc719f978693 P 1c45912f4aaf4a8083d01283f93c255e: Time spent starting tablet: real 0.000s user 0.002s sys 0.000s
I20260615 08:09:10.660701 14590 tablet_copy_service.cc:342] P d2ef54160cb2471ea1d740709d6446b7: Request end of tablet copy session 1c45912f4aaf4a8083d01283f93c255e-2aee5f7f624a45c0be14bc719f978693 received from {username='slave'} at 127.0.0.1:47592
I20260615 08:09:10.660789 14590 tablet_copy_service.cc:434] P d2ef54160cb2471ea1d740709d6446b7: ending tablet copy session 1c45912f4aaf4a8083d01283f93c255e-2aee5f7f624a45c0be14bc719f978693 on tablet 2aee5f7f624a45c0be14bc719f978693 with peer 1c45912f4aaf4a8083d01283f93c255e
I20260615 08:09:10.665729 15451 maintenance_manager.cc:419] P 1c45912f4aaf4a8083d01283f93c255e: Scheduling UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693): 7919173 bytes on disk
I20260615 08:09:10.665928 15391 maintenance_manager.cc:643] P 1c45912f4aaf4a8083d01283f93c255e: UndoDeltaBlockGCOp(2aee5f7f624a45c0be14bc719f978693) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":21,"lbm_reads_lt_1ms":4}
I20260615 08:09:10.942653 15424 raft_consensus.cc:1217] T 2aee5f7f624a45c0be14bc719f978693 P 1c45912f4aaf4a8083d01283f93c255e [term 2 LEARNER]: Deduplicated request from leader. Original: 2.13937->[2.13938-2.13938] Dedup: 2.13938->[]
I20260615 08:09:11.107278 14466 maintenance_manager.cc:419] P 8441fd568a084c40a32d3b05578699b1: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.000728
I20260615 08:09:11.109714 14465 maintenance_manager.cc:643] P 8441fd568a084c40a32d3b05578699b1: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.002s user 0.000s sys 0.000s Metrics: {"bytes_written":472,"delete_count":0,"lbm_write_time_us":85,"lbm_writes_lt_1ms":4,"reinsert_count":0,"thread_start_us":48,"threads_started":1,"update_count":1,"wal-append.queue_time_us":96}
I20260615 08:09:11.109845 14466 maintenance_manager.cc:419] P 8441fd568a084c40a32d3b05578699b1: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.216713
I20260615 08:09:11.111101 14465 maintenance_manager.cc:643] P 8441fd568a084c40a32d3b05578699b1: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.001s sys 0.000s Metrics: {"cfile_cache_miss":5,"cfile_cache_miss_bytes":2136,"cfile_init":3,"delete_count":0,"delta_blocks_compacted":1,"delta_iterators_relevant":1,"dirs.queue_time_us":161,"lbm_read_time_us":47,"lbm_reads_lt_1ms":17,"lbm_write_time_us":70,"lbm_writes_lt_1ms":9,"peak_mem_usage":33563,"reinsert_count":0,"thread_start_us":113,"threads_started":2,"update_count":1}
I20260615 08:09:11.123291 4267 tablet_server.cc:179] TabletServer@127.4.42.193:0 shutting down...
I20260615 08:09:11.126245 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:09:11.126364 4267 tablet_replica.cc:333] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7: stopping tablet replica
I20260615 08:09:11.126431 4267 raft_consensus.cc:2243] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7 [term 2 LEADER]: Raft consensus shutting down.
I20260615 08:09:11.126580 4267 raft_consensus.cc:2272] T 2aee5f7f624a45c0be14bc719f978693 P d2ef54160cb2471ea1d740709d6446b7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:09:11.138660 4267 tablet_server.cc:196] TabletServer@127.4.42.193:0 shutdown complete.
I20260615 08:09:11.139853 4267 tablet_server.cc:179] TabletServer@127.4.42.195:0 shutting down...
I20260615 08:09:11.143550 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:09:11.143656 4267 tablet_replica.cc:333] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4: stopping tablet replica
I20260615 08:09:11.143709 4267 raft_consensus.cc:2243] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260615 08:09:11.143790 4267 raft_consensus.cc:2272] T 2aee5f7f624a45c0be14bc719f978693 P ccd348dbed854f12940183b7be1966c4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260615 08:09:11.155342 4267 tablet_server.cc:196] TabletServer@127.4.42.195:0 shutdown complete.
I20260615 08:09:11.156278 4267 tablet_server.cc:179] TabletServer@127.4.42.196:0 shutting down...
I20260615 08:09:11.158910 4267 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260615 08:09:11.159054 4267 tablet_replica.cc:333] T 2aee5f7f624a45c0be14bc719f978693 P 1c45912f4aaf4a8083d01283f93c255e: stopping tablet replica
I20260615 08:09:11.159116 4267 raft_consensus.cc:2243] T 2aee5f7f624a45c0be14bc719f978693 P 1c45912f4aaf4a8083d01283f93c255e [term 2 LEARNER]: Raft consensus shutting down.
I20260615 08:09:11.159159 4267 raft_consensus.cc:2272] T 2aee5f7f624a45c0be14bc719f978693 P 1c45912f4aaf4a8083d01283f93c255e [term 2 LEARNER]: Raft consensus is shut down!
I20260615 08:09:11.170549 4267 tablet_server.cc:196] TabletServer@127.4.42.196:0 shutdown complete.
I20260615 08:09:11.171440 4267 master.cc:562] Master@127.4.42.254:41635 shutting down...
I20260615 08:09:11.174002 4267 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8441fd568a084c40a32d3b05578699b1 [term 1 LEADER]: Raft consensus shutting down.
I20260615 08:09:11.174077 4267 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8441fd568a084c40a32d3b05578699b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260615 08:09:11.174113 4267 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8441fd568a084c40a32d3b05578699b1: stopping tablet replica
I20260615 08:09:11.186622 4267 master.cc:584] Master@127.4.42.254:41635 shutdown complete.
[ OK ] ShouldGCWals/ParticipantCopyITest.TestCopyParticipantOps/0 (25180 ms)
[ RUN ] ShouldGCWals/ParticipantCopyITest.TestCopyParticipantOps/1
I20260615 08:09:11.214192 4267 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.42.254:36389
I20260615 08:09:11.214366 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:09:11.215430 15496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:09:11.215503 15497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:09:11.215516 15499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:09:11.215632 4267 server_base.cc:1061] running on GCE node
I20260615 08:09:11.215705 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:09:11.215734 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:09:11.215762 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510951215761 us; error 0 us; skew 500 ppm
I20260615 08:09:11.216327 4267 webserver.cc:533] Webserver started at http://127.4.42.254:38311/ using document root <none> and password file <none>
I20260615 08:09:11.216410 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:09:11.216455 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:09:11.216500 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:09:11.216769 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/master-0-root/instance:
uuid: "6ddda124f60546f0a99159dd803e39f1"
format_stamp: "Formatted at 2026-06-15 08:09:11 on dist-test-slave-37n8"
I20260615 08:09:11.217614 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260615 08:09:11.218044 15504 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:09:11.218164 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:09:11.218221 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/master-0-root
uuid: "6ddda124f60546f0a99159dd803e39f1"
format_stamp: "Formatted at 2026-06-15 08:09:11 on dist-test-slave-37n8"
I20260615 08:09:11.218266 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:09:11.232594 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:09:11.232728 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:09:11.235214 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.254:36389
I20260615 08:09:11.241882 15557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:09:11.241889 15556 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.254:36389 every 8 connection(s)
I20260615 08:09:11.242897 15557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ddda124f60546f0a99159dd803e39f1: Bootstrap starting.
I20260615 08:09:11.243184 15557 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ddda124f60546f0a99159dd803e39f1: Neither blocks nor log segments found. Creating new log.
I20260615 08:09:11.243606 15557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ddda124f60546f0a99159dd803e39f1: No bootstrap required, opened a new log
I20260615 08:09:11.243700 15557 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6ddda124f60546f0a99159dd803e39f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ddda124f60546f0a99159dd803e39f1" member_type: VOTER }
I20260615 08:09:11.243739 15557 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6ddda124f60546f0a99159dd803e39f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:09:11.243752 15557 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6ddda124f60546f0a99159dd803e39f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ddda124f60546f0a99159dd803e39f1, State: Initialized, Role: FOLLOWER
I20260615 08:09:11.243803 15557 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ddda124f60546f0a99159dd803e39f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ddda124f60546f0a99159dd803e39f1" member_type: VOTER }
I20260615 08:09:11.243847 15557 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6ddda124f60546f0a99159dd803e39f1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260615 08:09:11.243863 15557 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6ddda124f60546f0a99159dd803e39f1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260615 08:09:11.243876 15557 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6ddda124f60546f0a99159dd803e39f1 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:09:11.244292 15557 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6ddda124f60546f0a99159dd803e39f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ddda124f60546f0a99159dd803e39f1" member_type: VOTER }
I20260615 08:09:11.244338 15557 leader_election.cc:304] T 00000000000000000000000000000000 P 6ddda124f60546f0a99159dd803e39f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6ddda124f60546f0a99159dd803e39f1; no voters:
I20260615 08:09:11.244433 15557 leader_election.cc:290] T 00000000000000000000000000000000 P 6ddda124f60546f0a99159dd803e39f1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260615 08:09:11.244467 15560 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6ddda124f60546f0a99159dd803e39f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:09:11.244575 15557 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6ddda124f60546f0a99159dd803e39f1 [sys.catalog]: configured and running, proceeding with master startup.
I20260615 08:09:11.244582 15560 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6ddda124f60546f0a99159dd803e39f1 [term 1 LEADER]: Becoming Leader. State: Replica: 6ddda124f60546f0a99159dd803e39f1, State: Running, Role: LEADER
I20260615 08:09:11.244678 15560 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ddda124f60546f0a99159dd803e39f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ddda124f60546f0a99159dd803e39f1" member_type: VOTER }
I20260615 08:09:11.244879 15560 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ddda124f60546f0a99159dd803e39f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ddda124f60546f0a99159dd803e39f1. Latest consensus state: current_term: 1 leader_uuid: "6ddda124f60546f0a99159dd803e39f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ddda124f60546f0a99159dd803e39f1" member_type: VOTER } }
I20260615 08:09:11.244906 15562 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ddda124f60546f0a99159dd803e39f1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6ddda124f60546f0a99159dd803e39f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ddda124f60546f0a99159dd803e39f1" member_type: VOTER } }
I20260615 08:09:11.245010 15560 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ddda124f60546f0a99159dd803e39f1 [sys.catalog]: This master's current role is: LEADER
I20260615 08:09:11.245103 15562 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ddda124f60546f0a99159dd803e39f1 [sys.catalog]: This master's current role is: LEADER
I20260615 08:09:11.245422 15568 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260615 08:09:11.245555 15568 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260615 08:09:11.245945 4267 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260615 08:09:11.246057 15568 catalog_manager.cc:1382] Generated new cluster ID: cf1f82a5d54145e292493b973a1dda29
I20260615 08:09:11.246090 15568 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260615 08:09:11.250481 15568 catalog_manager.cc:1405] Generated new certificate authority record
I20260615 08:09:11.250955 15568 catalog_manager.cc:1539] Loading token signing keys...
I20260615 08:09:11.256299 15568 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 6ddda124f60546f0a99159dd803e39f1: Generated new TSK 0
I20260615 08:09:11.256372 15568 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260615 08:09:11.261518 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:09:11.262578 15579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:09:11.262641 15581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:09:11.262658 15578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:09:11.262754 4267 server_base.cc:1061] running on GCE node
I20260615 08:09:11.262869 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:09:11.262904 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:09:11.262930 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510951262930 us; error 0 us; skew 500 ppm
I20260615 08:09:11.263517 4267 webserver.cc:533] Webserver started at http://127.4.42.193:36027/ using document root <none> and password file <none>
I20260615 08:09:11.263602 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:09:11.263643 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:09:11.263686 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:09:11.263923 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-0-root/instance:
uuid: "371b4da9afb846b5b3c4b9a9e0831650"
format_stamp: "Formatted at 2026-06-15 08:09:11 on dist-test-slave-37n8"
I20260615 08:09:11.264794 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:09:11.265213 15586 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:09:11.265328 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:09:11.265372 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-0-root
uuid: "371b4da9afb846b5b3c4b9a9e0831650"
format_stamp: "Formatted at 2026-06-15 08:09:11 on dist-test-slave-37n8"
I20260615 08:09:11.265412 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:09:11.269495 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:09:11.269620 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:09:11.269719 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:09:11.269857 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:09:11.269897 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:09:11.269914 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:09:11.269927 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:09:11.272563 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.193:35243
I20260615 08:09:11.272603 15649 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.193:35243 every 8 connection(s)
I20260615 08:09:11.272927 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:09:11.273831 15654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:09:11.274044 15655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:09:11.274266 15657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:09:11.274286 4267 server_base.cc:1061] running on GCE node
I20260615 08:09:11.274413 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:09:11.274448 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:09:11.274466 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510951274466 us; error 0 us; skew 500 ppm
I20260615 08:09:11.275054 4267 webserver.cc:533] Webserver started at http://127.4.42.194:44153/ using document root <none> and password file <none>
I20260615 08:09:11.275158 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:09:11.275202 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:09:11.275246 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:09:11.275463 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-1-root/instance:
uuid: "a4dd9f5055864b28a3998e289ddb3760"
format_stamp: "Formatted at 2026-06-15 08:09:11 on dist-test-slave-37n8"
I20260615 08:09:11.276340 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260615 08:09:11.276660 15650 heartbeater.cc:344] Connected to a master server at 127.4.42.254:36389
I20260615 08:09:11.276731 15650 heartbeater.cc:461] Registering TS with master...
I20260615 08:09:11.276827 15650 heartbeater.cc:507] Master 127.4.42.254:36389 requested a full tablet report, sending...
I20260615 08:09:11.276870 15662 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:09:11.276976 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260615 08:09:11.277031 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-1-root
uuid: "a4dd9f5055864b28a3998e289ddb3760"
format_stamp: "Formatted at 2026-06-15 08:09:11 on dist-test-slave-37n8"
I20260615 08:09:11.277051 15521 ts_manager.cc:194] Registered new tserver with Master: 371b4da9afb846b5b3c4b9a9e0831650 (127.4.42.193:35243)
I20260615 08:09:11.277086 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:09:11.277626 15521 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37604
I20260615 08:09:11.286829 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:09:11.287011 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:09:11.287159 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:09:11.287354 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:09:11.287396 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:09:11.287436 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:09:11.287464 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:09:11.290099 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.194:44431
I20260615 08:09:11.290153 15725 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.194:44431 every 8 connection(s)
I20260615 08:09:11.290475 4267 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260615 08:09:11.291548 15729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260615 08:09:11.291682 15730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:09:11.291797 4267 server_base.cc:1061] running on GCE node
W20260615 08:09:11.291864 15732 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260615 08:09:11.292042 4267 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260615 08:09:11.292090 4267 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260615 08:09:11.292107 4267 hybrid_clock.cc:648] HybridClock initialized: now 1781510951292108 us; error 0 us; skew 500 ppm
I20260615 08:09:11.292704 4267 webserver.cc:533] Webserver started at http://127.4.42.195:34823/ using document root <none> and password file <none>
I20260615 08:09:11.292788 4267 fs_manager.cc:362] Metadata directory not provided
I20260615 08:09:11.292827 4267 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260615 08:09:11.292866 4267 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260615 08:09:11.293216 4267 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-2-root/instance:
uuid: "4d643312c2624f1f9426f230a68981b0"
format_stamp: "Formatted at 2026-06-15 08:09:11 on dist-test-slave-37n8"
I20260615 08:09:11.293779 15726 heartbeater.cc:344] Connected to a master server at 127.4.42.254:36389
I20260615 08:09:11.293834 15726 heartbeater.cc:461] Registering TS with master...
I20260615 08:09:11.293938 15726 heartbeater.cc:507] Master 127.4.42.254:36389 requested a full tablet report, sending...
I20260615 08:09:11.294245 15521 ts_manager.cc:194] Registered new tserver with Master: a4dd9f5055864b28a3998e289ddb3760 (127.4.42.194:44431)
I20260615 08:09:11.294554 4267 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260615 08:09:11.294721 15521 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37614
I20260615 08:09:11.295087 15737 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260615 08:09:11.295233 4267 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260615 08:09:11.295295 4267 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-2-root
uuid: "4d643312c2624f1f9426f230a68981b0"
format_stamp: "Formatted at 2026-06-15 08:09:11 on dist-test-slave-37n8"
I20260615 08:09:11.295341 4267 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260615 08:09:11.308187 4267 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260615 08:09:11.308377 4267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260615 08:09:11.308521 4267 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260615 08:09:11.308724 4267 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260615 08:09:11.308765 4267 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260615 08:09:11.308804 4267 ts_tablet_manager.cc:616] Registered 0 tablets
I20260615 08:09:11.308833 4267 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260615 08:09:11.311515 4267 rpc_server.cc:307] RPC server started. Bound to: 127.4.42.195:36461
I20260615 08:09:11.311564 15800 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.42.195:36461 every 8 connection(s)
I20260615 08:09:11.314236 15801 heartbeater.cc:344] Connected to a master server at 127.4.42.254:36389
I20260615 08:09:11.314287 15801 heartbeater.cc:461] Registering TS with master...
I20260615 08:09:11.314388 15801 heartbeater.cc:507] Master 127.4.42.254:36389 requested a full tablet report, sending...
I20260615 08:09:11.314651 15521 ts_manager.cc:194] Registered new tserver with Master: 4d643312c2624f1f9426f230a68981b0 (127.4.42.195:36461)
I20260615 08:09:11.314967 15521 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37620
I20260615 08:09:11.314987 4267 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.00328408s
I20260615 08:09:11.319545 15521 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37634:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260615 08:09:11.319670 15521 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260615 08:09:11.324352 15614 tablet_service.cc:1511] Processing CreateTablet for tablet 2a7cfbffb47d4c6388ffb6b85d9f75f0 (DEFAULT_TABLE table=test-workload [id=ba2db50e7b8040dc83840221209f2b22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:09:11.324422 15765 tablet_service.cc:1511] Processing CreateTablet for tablet 2a7cfbffb47d4c6388ffb6b85d9f75f0 (DEFAULT_TABLE table=test-workload [id=ba2db50e7b8040dc83840221209f2b22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:09:11.324466 15614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a7cfbffb47d4c6388ffb6b85d9f75f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:09:11.324539 15765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a7cfbffb47d4c6388ffb6b85d9f75f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:09:11.324678 15690 tablet_service.cc:1511] Processing CreateTablet for tablet 2a7cfbffb47d4c6388ffb6b85d9f75f0 (DEFAULT_TABLE table=test-workload [id=ba2db50e7b8040dc83840221209f2b22]), partition=RANGE (key) PARTITION UNBOUNDED
I20260615 08:09:11.324764 15690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a7cfbffb47d4c6388ffb6b85d9f75f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260615 08:09:11.325742 15816 tablet_bootstrap.cc:492] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 4d643312c2624f1f9426f230a68981b0: Bootstrap starting.
I20260615 08:09:11.326001 15817 tablet_bootstrap.cc:492] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650: Bootstrap starting.
I20260615 08:09:11.326217 15816 tablet_bootstrap.cc:654] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 4d643312c2624f1f9426f230a68981b0: Neither blocks nor log segments found. Creating new log.
I20260615 08:09:11.326371 15817 tablet_bootstrap.cc:654] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650: Neither blocks nor log segments found. Creating new log.
I20260615 08:09:11.326579 15818 tablet_bootstrap.cc:492] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P a4dd9f5055864b28a3998e289ddb3760: Bootstrap starting.
I20260615 08:09:11.326871 15816 tablet_bootstrap.cc:492] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 4d643312c2624f1f9426f230a68981b0: No bootstrap required, opened a new log
I20260615 08:09:11.326920 15816 ts_tablet_manager.cc:1403] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 4d643312c2624f1f9426f230a68981b0: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260615 08:09:11.326985 15817 tablet_bootstrap.cc:492] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650: No bootstrap required, opened a new log
I20260615 08:09:11.327032 15817 ts_tablet_manager.cc:1403] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260615 08:09:11.327051 15818 tablet_bootstrap.cc:654] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P a4dd9f5055864b28a3998e289ddb3760: Neither blocks nor log segments found. Creating new log.
I20260615 08:09:11.327065 15816 raft_consensus.cc:359] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 4d643312c2624f1f9426f230a68981b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d643312c2624f1f9426f230a68981b0" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 36461 } } peers { permanent_uuid: "a4dd9f5055864b28a3998e289ddb3760" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 44431 } } peers { permanent_uuid: "371b4da9afb846b5b3c4b9a9e0831650" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 35243 } }
I20260615 08:09:11.327107 15816 raft_consensus.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 4d643312c2624f1f9426f230a68981b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:09:11.327121 15816 raft_consensus.cc:740] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 4d643312c2624f1f9426f230a68981b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d643312c2624f1f9426f230a68981b0, State: Initialized, Role: FOLLOWER
I20260615 08:09:11.327142 15817 raft_consensus.cc:359] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d643312c2624f1f9426f230a68981b0" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 36461 } } peers { permanent_uuid: "a4dd9f5055864b28a3998e289ddb3760" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 44431 } } peers { permanent_uuid: "371b4da9afb846b5b3c4b9a9e0831650" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 35243 } }
I20260615 08:09:11.327171 15816 consensus_queue.cc:260] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 4d643312c2624f1f9426f230a68981b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d643312c2624f1f9426f230a68981b0" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 36461 } } peers { permanent_uuid: "a4dd9f5055864b28a3998e289ddb3760" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 44431 } } peers { permanent_uuid: "371b4da9afb846b5b3c4b9a9e0831650" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 35243 } }
I20260615 08:09:11.327203 15817 raft_consensus.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:09:11.327232 15817 raft_consensus.cc:740] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b4da9afb846b5b3c4b9a9e0831650, State: Initialized, Role: FOLLOWER
I20260615 08:09:11.327296 15817 consensus_queue.cc:260] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d643312c2624f1f9426f230a68981b0" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 36461 } } peers { permanent_uuid: "a4dd9f5055864b28a3998e289ddb3760" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 44431 } } peers { permanent_uuid: "371b4da9afb846b5b3c4b9a9e0831650" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 35243 } }
I20260615 08:09:11.327332 15816 ts_tablet_manager.cc:1434] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 4d643312c2624f1f9426f230a68981b0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260615 08:09:11.327418 15801 heartbeater.cc:499] Master 127.4.42.254:36389 was elected leader, sending a full tablet report...
I20260615 08:09:11.327443 15817 ts_tablet_manager.cc:1434] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260615 08:09:11.327523 15818 tablet_bootstrap.cc:492] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P a4dd9f5055864b28a3998e289ddb3760: No bootstrap required, opened a new log
I20260615 08:09:11.327556 15650 heartbeater.cc:499] Master 127.4.42.254:36389 was elected leader, sending a full tablet report...
I20260615 08:09:11.327697 15818 ts_tablet_manager.cc:1403] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P a4dd9f5055864b28a3998e289ddb3760: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260615 08:09:11.327805 15818 raft_consensus.cc:359] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P a4dd9f5055864b28a3998e289ddb3760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d643312c2624f1f9426f230a68981b0" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 36461 } } peers { permanent_uuid: "a4dd9f5055864b28a3998e289ddb3760" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 44431 } } peers { permanent_uuid: "371b4da9afb846b5b3c4b9a9e0831650" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 35243 } }
I20260615 08:09:11.327876 15818 raft_consensus.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P a4dd9f5055864b28a3998e289ddb3760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260615 08:09:11.327909 15818 raft_consensus.cc:740] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P a4dd9f5055864b28a3998e289ddb3760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4dd9f5055864b28a3998e289ddb3760, State: Initialized, Role: FOLLOWER
I20260615 08:09:11.328063 15818 consensus_queue.cc:260] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P a4dd9f5055864b28a3998e289ddb3760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d643312c2624f1f9426f230a68981b0" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 36461 } } peers { permanent_uuid: "a4dd9f5055864b28a3998e289ddb3760" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 44431 } } peers { permanent_uuid: "371b4da9afb846b5b3c4b9a9e0831650" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 35243 } }
I20260615 08:09:11.328222 15818 ts_tablet_manager.cc:1434] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P a4dd9f5055864b28a3998e289ddb3760: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260615 08:09:11.328260 15726 heartbeater.cc:499] Master 127.4.42.254:36389 was elected leader, sending a full tablet report...
I20260615 08:09:11.355432 15823 raft_consensus.cc:493] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260615 08:09:11.355499 15823 raft_consensus.cc:515] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d643312c2624f1f9426f230a68981b0" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 36461 } } peers { permanent_uuid: "a4dd9f5055864b28a3998e289ddb3760" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 44431 } } peers { permanent_uuid: "371b4da9afb846b5b3c4b9a9e0831650" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 35243 } }
I20260615 08:09:11.355715 15823 leader_election.cc:290] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d643312c2624f1f9426f230a68981b0 (127.4.42.195:36461), a4dd9f5055864b28a3998e289ddb3760 (127.4.42.194:44431)
I20260615 08:09:11.358175 15775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a7cfbffb47d4c6388ffb6b85d9f75f0" candidate_uuid: "371b4da9afb846b5b3c4b9a9e0831650" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d643312c2624f1f9426f230a68981b0" is_pre_election: true
I20260615 08:09:11.358258 15775 raft_consensus.cc:2468] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 4d643312c2624f1f9426f230a68981b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371b4da9afb846b5b3c4b9a9e0831650 in term 0.
I20260615 08:09:11.358175 15700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a7cfbffb47d4c6388ffb6b85d9f75f0" candidate_uuid: "371b4da9afb846b5b3c4b9a9e0831650" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4dd9f5055864b28a3998e289ddb3760" is_pre_election: true
I20260615 08:09:11.358295 15700 raft_consensus.cc:2468] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P a4dd9f5055864b28a3998e289ddb3760 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 371b4da9afb846b5b3c4b9a9e0831650 in term 0.
I20260615 08:09:11.358393 15587 leader_election.cc:304] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b4da9afb846b5b3c4b9a9e0831650, 4d643312c2624f1f9426f230a68981b0; no voters:
I20260615 08:09:11.358505 15823 raft_consensus.cc:2804] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260615 08:09:11.358556 15823 raft_consensus.cc:493] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260615 08:09:11.358575 15823 raft_consensus.cc:3060] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:09:11.359163 15823 raft_consensus.cc:515] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d643312c2624f1f9426f230a68981b0" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 36461 } } peers { permanent_uuid: "a4dd9f5055864b28a3998e289ddb3760" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 44431 } } peers { permanent_uuid: "371b4da9afb846b5b3c4b9a9e0831650" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 35243 } }
I20260615 08:09:11.359290 15823 leader_election.cc:290] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650 [CANDIDATE]: Term 1 election: Requested vote from peers 4d643312c2624f1f9426f230a68981b0 (127.4.42.195:36461), a4dd9f5055864b28a3998e289ddb3760 (127.4.42.194:44431)
I20260615 08:09:11.359416 15700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a7cfbffb47d4c6388ffb6b85d9f75f0" candidate_uuid: "371b4da9afb846b5b3c4b9a9e0831650" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4dd9f5055864b28a3998e289ddb3760"
I20260615 08:09:11.359488 15700 raft_consensus.cc:3060] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P a4dd9f5055864b28a3998e289ddb3760 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:09:11.359455 15775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a7cfbffb47d4c6388ffb6b85d9f75f0" candidate_uuid: "371b4da9afb846b5b3c4b9a9e0831650" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d643312c2624f1f9426f230a68981b0"
I20260615 08:09:11.359527 15775 raft_consensus.cc:3060] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 4d643312c2624f1f9426f230a68981b0 [term 0 FOLLOWER]: Advancing to term 1
I20260615 08:09:11.360056 15700 raft_consensus.cc:2468] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P a4dd9f5055864b28a3998e289ddb3760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b4da9afb846b5b3c4b9a9e0831650 in term 1.
I20260615 08:09:11.360163 15775 raft_consensus.cc:2468] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 4d643312c2624f1f9426f230a68981b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 371b4da9afb846b5b3c4b9a9e0831650 in term 1.
I20260615 08:09:11.360255 15589 leader_election.cc:304] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b4da9afb846b5b3c4b9a9e0831650, a4dd9f5055864b28a3998e289ddb3760; no voters:
I20260615 08:09:11.360355 15823 raft_consensus.cc:2804] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650 [term 1 FOLLOWER]: Leader election won for term 1
I20260615 08:09:11.360477 15823 raft_consensus.cc:697] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650 [term 1 LEADER]: Becoming Leader. State: Replica: 371b4da9afb846b5b3c4b9a9e0831650, State: Running, Role: LEADER
I20260615 08:09:11.360549 15823 consensus_queue.cc:237] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d643312c2624f1f9426f230a68981b0" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 36461 } } peers { permanent_uuid: "a4dd9f5055864b28a3998e289ddb3760" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 44431 } } peers { permanent_uuid: "371b4da9afb846b5b3c4b9a9e0831650" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 35243 } }
I20260615 08:09:11.361042 15520 catalog_manager.cc:5696] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650 reported cstate change: term changed from 0 to 1, leader changed from <none> to 371b4da9afb846b5b3c4b9a9e0831650 (127.4.42.193). New cstate: current_term: 1 leader_uuid: "371b4da9afb846b5b3c4b9a9e0831650" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4d643312c2624f1f9426f230a68981b0" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 36461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4dd9f5055864b28a3998e289ddb3760" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 44431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "371b4da9afb846b5b3c4b9a9e0831650" member_type: VOTER last_known_addr { host: "127.4.42.193" port: 35243 } health_report { overall_health: HEALTHY } } }
I20260615 08:09:11.376022 15700 raft_consensus.cc:1275] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P a4dd9f5055864b28a3998e289ddb3760 [term 1 FOLLOWER]: Refusing update from remote peer 371b4da9afb846b5b3c4b9a9e0831650: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:09:11.376024 15775 raft_consensus.cc:1275] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 4d643312c2624f1f9426f230a68981b0 [term 1 FOLLOWER]: Refusing update from remote peer 371b4da9afb846b5b3c4b9a9e0831650: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260615 08:09:11.376211 15823 consensus_queue.cc:1048] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d643312c2624f1f9426f230a68981b0" member_type: VOTER last_known_addr { host: "127.4.42.195" port: 36461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:09:11.376300 15826 consensus_queue.cc:1048] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4dd9f5055864b28a3998e289ddb3760" member_type: VOTER last_known_addr { host: "127.4.42.194" port: 44431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260615 08:09:11.377979 15833 mvcc.cc:204] Tried to move back new op lower bound from 7297068856836894720 to 7297068856773296128. Current Snapshot: MvccSnapshot[applied={T|T < 7297068856835792896}]
I20260615 08:09:11.513120 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:11.514647 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:11.518586 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:11.555002 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.042s user 0.008s sys 0.008s Metrics: {"bytes_written":283068,"cfile_init":1,"dirs.queue_time_us":44,"dirs.run_cpu_time_us":112,"dirs.run_wall_time_us":818,"drs_written":1,"lbm_read_time_us":21,"lbm_reads_lt_1ms":4,"lbm_write_time_us":638,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9850}
I20260615 08:09:11.555751 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.041s user 0.012s sys 0.004s Metrics: {"bytes_written":283068,"cfile_init":1,"dirs.queue_time_us":27,"dirs.run_cpu_time_us":89,"dirs.run_wall_time_us":626,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":664,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9850}
I20260615 08:09:11.555889 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 90952 bytes on disk
I20260615 08:09:11.556440 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.038s user 0.015s sys 0.000s Metrics: {"bytes_written":300395,"cfile_init":1,"dirs.queue_time_us":45,"dirs.run_cpu_time_us":63,"dirs.run_wall_time_us":470,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":676,"lbm_writes_lt_1ms":33,"peak_mem_usage":0,"rows_written":10350}
I20260615 08:09:11.558998 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 95562 bytes on disk
I20260615 08:09:11.559141 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 90952 bytes on disk
I20260615 08:09:11.559180 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20260615 08:09:11.559015 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20260615 08:09:11.559796 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":23,"lbm_reads_lt_1ms":4}
I20260615 08:09:11.661779 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:11.670730 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:11.673427 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.012s user 0.010s sys 0.000s Metrics: {"bytes_written":271096,"cfile_init":1,"dirs.queue_time_us":24,"dirs.run_cpu_time_us":148,"dirs.run_wall_time_us":630,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":537,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9400}
I20260615 08:09:11.673591 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 86559 bytes on disk
I20260615 08:09:11.673727 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":21,"lbm_reads_lt_1ms":4}
I20260615 08:09:11.673832 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.014740
I20260615 08:09:11.680756 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:11.685104 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.014s user 0.009s sys 0.003s Metrics: {"bytes_written":276456,"cfile_init":1,"dirs.queue_time_us":42,"dirs.run_cpu_time_us":111,"dirs.run_wall_time_us":464,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":662,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9600}
I20260615 08:09:11.685251 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.014738
I20260615 08:09:11.701200 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.027s user 0.021s sys 0.003s Metrics: {"bytes_written":550254,"cfile_cache_hit":12,"cfile_cache_hit_bytes":424237,"cfile_cache_miss":40,"cfile_cache_miss_bytes":938693,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":112,"dirs.run_cpu_time_us":89,"dirs.run_wall_time_us":436,"drs_written":1,"lbm_read_time_us":767,"lbm_reads_lt_1ms":60,"lbm_write_time_us":1010,"lbm_writes_lt_1ms":43,"num_input_rowsets":2,"peak_mem_usage":293394,"rows_written":19250,"spinlock_wait_cycles":4736,"thread_start_us":298,"threads_started":5}
I20260615 08:09:11.701630 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 182774 bytes on disk
I20260615 08:09:11.701802 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:09:11.703531 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.023s user 0.014s sys 0.000s Metrics: {"bytes_written":271127,"cfile_init":1,"dirs.queue_time_us":24,"dirs.run_cpu_time_us":92,"dirs.run_wall_time_us":422,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":726,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9400}
I20260615 08:09:11.703692 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 86739 bytes on disk
I20260615 08:09:11.703846 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20260615 08:09:11.703964 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.014736
I20260615 08:09:11.723379 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.038s user 0.028s sys 0.002s Metrics: {"bytes_written":555507,"cfile_cache_hit":12,"cfile_cache_hit_bytes":428087,"cfile_cache_miss":40,"cfile_cache_miss_bytes":949375,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":97,"dirs.run_cpu_time_us":86,"dirs.run_wall_time_us":674,"drs_written":1,"lbm_read_time_us":766,"lbm_reads_lt_1ms":64,"lbm_write_time_us":2130,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":42,"num_input_rowsets":2,"peak_mem_usage":296444,"rows_written":19450,"thread_start_us":297,"threads_started":5}
I20260615 08:09:11.723695 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 184711 bytes on disk
I20260615 08:09:11.723886 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:09:11.752034 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.048s user 0.033s sys 0.000s Metrics: {"bytes_written":563408,"cfile_cache_hit":10,"cfile_cache_hit_bytes":372398,"cfile_cache_miss":42,"cfile_cache_miss_bytes":1026592,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":155,"dirs.run_cpu_time_us":99,"dirs.run_wall_time_us":491,"drs_written":1,"lbm_read_time_us":822,"lbm_reads_lt_1ms":62,"lbm_write_time_us":1296,"lbm_writes_lt_1ms":44,"num_input_rowsets":2,"peak_mem_usage":301019,"rows_written":19750,"thread_start_us":246,"threads_started":5}
I20260615 08:09:11.752265 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 188304 bytes on disk
I20260615 08:09:11.752418 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20260615 08:09:11.833611 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:11.835870 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:11.843717 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:11.853478 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.018s user 0.003s sys 0.008s Metrics: {"bytes_written":279137,"cfile_init":1,"dirs.queue_time_us":46,"dirs.run_cpu_time_us":114,"dirs.run_wall_time_us":514,"drs_written":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4,"lbm_write_time_us":522,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9700}
I20260615 08:09:11.853832 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 89362 bytes on disk
I20260615 08:09:11.854350 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20260615 08:09:11.854549 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.014556
I20260615 08:09:11.858652 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.015s user 0.013s sys 0.000s Metrics: {"bytes_written":279185,"cfile_init":1,"dirs.queue_time_us":27,"dirs.run_cpu_time_us":69,"dirs.run_wall_time_us":416,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":870,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9700}
I20260615 08:09:11.858841 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1048803 bytes of WAL
I20260615 08:09:11.858951 15591 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:11.859021 15591 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000001 (ops 1-579)
I20260615 08:09:11.859500 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:11.859696 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.014553
I20260615 08:09:11.865579 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.032s user 0.012s sys 0.000s Metrics: {"bytes_written":279232,"cfile_init":1,"dirs.queue_time_us":3181,"dirs.run_cpu_time_us":85,"dirs.run_wall_time_us":506,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":659,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9700}
I20260615 08:09:11.865722 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.014559
I20260615 08:09:11.906411 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.047s user 0.036s sys 0.008s Metrics: {"bytes_written":838914,"cfile_cache_hit":10,"cfile_cache_hit_bytes":445310,"cfile_cache_miss":54,"cfile_cache_miss_bytes":1645306,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":29,"dirs.run_cpu_time_us":113,"dirs.run_wall_time_us":507,"drs_written":1,"lbm_read_time_us":1109,"lbm_reads_lt_1ms":78,"lbm_write_time_us":1875,"lbm_writes_lt_1ms":55,"num_input_rowsets":2,"peak_mem_usage":448924,"rows_written":29450}
I20260615 08:09:11.907042 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 290244 bytes on disk
I20260615 08:09:11.907234 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20260615 08:09:11.946983 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.092s user 0.040s sys 0.005s Metrics: {"bytes_written":831074,"cfile_cache_hit":10,"cfile_cache_hit_bytes":445288,"cfile_cache_miss":52,"cfile_cache_miss_bytes":1622286,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":280,"dirs.run_cpu_time_us":122,"dirs.run_wall_time_us":584,"drs_written":1,"lbm_read_time_us":1061,"lbm_reads_lt_1ms":72,"lbm_write_time_us":1848,"lbm_writes_lt_1ms":55,"num_input_rowsets":2,"peak_mem_usage":444351,"rows_written":29150}
I20260615 08:09:11.947269 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 287137 bytes on disk
I20260615 08:09:11.947584 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:09:11.949719 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.075s user 0.043s sys 0.000s Metrics: {"bytes_written":821971,"cfile_cache_hit":11,"cfile_cache_hit_bytes":503076,"cfile_cache_miss":51,"cfile_cache_miss_bytes":1550458,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":1113,"dirs.run_cpu_time_us":111,"dirs.run_wall_time_us":644,"drs_written":1,"lbm_read_time_us":1380,"lbm_reads_lt_1ms":75,"lbm_write_time_us":1624,"lbm_writes_lt_1ms":54,"num_input_rowsets":2,"peak_mem_usage":441301,"rows_written":28950}
I20260615 08:09:11.950243 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 285137 bytes on disk
I20260615 08:09:11.950413 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20260615 08:09:12.021471 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:12.029250 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:12.039217 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:12.040123 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.019s user 0.012s sys 0.000s Metrics: {"bytes_written":275116,"cfile_init":1,"dirs.queue_time_us":1217,"dirs.run_cpu_time_us":124,"dirs.run_wall_time_us":835,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":731,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9550}
I20260615 08:09:12.040314 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1051616 bytes of WAL
I20260615 08:09:12.040410 15742 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:12.040445 15742 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 4d643312c2624f1f9426f230a68981b0: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000001 (ops 1-624)
I20260615 08:09:12.040789 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:12.040905 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.014511
I20260615 08:09:12.049626 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.020s user 0.012s sys 0.000s Metrics: {"bytes_written":276443,"cfile_init":1,"dirs.queue_time_us":27,"dirs.run_cpu_time_us":89,"dirs.run_wall_time_us":589,"drs_written":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4,"lbm_write_time_us":637,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9600}
I20260615 08:09:12.049875 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 88398 bytes on disk
I20260615 08:09:12.050048 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":22,"lbm_reads_lt_1ms":4}
I20260615 08:09:12.050159 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.014505
I20260615 08:09:12.052623 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.013s user 0.010s sys 0.002s Metrics: {"bytes_written":293486,"cfile_init":1,"dirs.queue_time_us":43,"dirs.run_cpu_time_us":78,"dirs.run_wall_time_us":376,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":562,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":10250}
I20260615 08:09:12.052868 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1049034 bytes of WAL
I20260615 08:09:12.054360 15667 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:12.054453 15667 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P a4dd9f5055864b28a3998e289ddb3760: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000001 (ops 1-624)
I20260615 08:09:12.054884 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:12.055014 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 94455 bytes on disk
I20260615 08:09:12.055167 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20260615 08:09:12.055308 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.014503
I20260615 08:09:12.102649 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.062s user 0.047s sys 0.004s Metrics: {"bytes_written":1092419,"cfile_cache_hit":12,"cfile_cache_hit_bytes":611502,"cfile_cache_miss":62,"cfile_cache_miss_bytes":2137740,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":165,"dirs.run_cpu_time_us":105,"dirs.run_wall_time_us":555,"drs_written":1,"lbm_read_time_us":1025,"lbm_reads_lt_1ms":86,"lbm_write_time_us":2276,"lbm_writes_lt_1ms":64,"num_input_rowsets":2,"peak_mem_usage":585266,"rows_written":38500}
I20260615 08:09:12.102936 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 385490 bytes on disk
I20260615 08:09:12.103091 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:09:12.123237 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.073s user 0.047s sys 0.004s Metrics: {"bytes_written":1106758,"cfile_cache_hit":11,"cfile_cache_hit_bytes":529653,"cfile_cache_miss":63,"cfile_cache_miss_bytes":2259065,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":139,"dirs.run_cpu_time_us":101,"dirs.run_wall_time_us":537,"drs_written":1,"lbm_read_time_us":1434,"lbm_reads_lt_1ms":83,"lbm_write_time_us":2023,"lbm_writes_lt_1ms":65,"num_input_rowsets":2,"peak_mem_usage":595306,"rows_written":39050}
I20260615 08:09:12.123531 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 391607 bytes on disk
I20260615 08:09:12.123698 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:09:12.146610 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.091s user 0.049s sys 0.004s Metrics: {"bytes_written":1119679,"cfile_cache_hit":12,"cfile_cache_hit_bytes":626033,"cfile_cache_miss":62,"cfile_cache_miss_bytes":2186983,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":1825,"dirs.run_cpu_time_us":83,"dirs.run_wall_time_us":404,"drs_written":1,"lbm_read_time_us":1516,"lbm_reads_lt_1ms":82,"lbm_write_time_us":5723,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":65,"num_input_rowsets":2,"peak_mem_usage":598991,"rows_written":39400,"spinlock_wait_cycles":2688}
I20260615 08:09:12.146778 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 395234 bytes on disk
I20260615 08:09:12.146931 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:09:12.204675 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:12.214886 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:12.221714 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.017s user 0.013s sys 0.000s Metrics: {"bytes_written":271169,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":124,"dirs.run_wall_time_us":676,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1020,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9400}
I20260615 08:09:12.221895 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 86722 bytes on disk
I20260615 08:09:12.222067 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":22,"lbm_reads_lt_1ms":4}
I20260615 08:09:12.222199 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.014383
I20260615 08:09:12.230648 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.016s user 0.013s sys 0.000s Metrics: {"bytes_written":273627,"cfile_init":1,"dirs.queue_time_us":105,"dirs.run_cpu_time_us":85,"dirs.run_wall_time_us":722,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":728,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9500}
I20260615 08:09:12.230867 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 87575 bytes on disk
I20260615 08:09:12.231043 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20260615 08:09:12.231235 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.014411
I20260615 08:09:12.238201 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:12.245304 15510 maintenance_manager.cc:419] P 6ddda124f60546f0a99159dd803e39f1: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.003577
I20260615 08:09:12.248438 15509 maintenance_manager.cc:643] P 6ddda124f60546f0a99159dd803e39f1: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.003s user 0.003s sys 0.000s Metrics: {"bytes_written":6632,"cfile_init":1,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":224,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"rows_written":5,"thread_start_us":67,"threads_started":1}
I20260615 08:09:12.248664 15510 maintenance_manager.cc:419] P 6ddda124f60546f0a99159dd803e39f1: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 482 bytes on disk
I20260615 08:09:12.248827 15509 maintenance_manager.cc:643] P 6ddda124f60546f0a99159dd803e39f1: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:09:12.259406 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.021s user 0.011s sys 0.001s Metrics: {"bytes_written":281587,"cfile_init":1,"dirs.queue_time_us":48,"dirs.run_cpu_time_us":124,"dirs.run_wall_time_us":538,"drs_written":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4,"lbm_write_time_us":568,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9800}
I20260615 08:09:12.259616 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 90429 bytes on disk
I20260615 08:09:12.259783 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4}
I20260615 08:09:12.259920 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.014404
I20260615 08:09:12.288761 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.066s user 0.059s sys 0.004s Metrics: {"bytes_written":1356803,"cfile_cache_hit":10,"cfile_cache_hit_bytes":439735,"cfile_cache_miss":72,"cfile_cache_miss_bytes":2991405,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":146,"dirs.run_cpu_time_us":89,"dirs.run_wall_time_us":694,"drs_written":1,"lbm_read_time_us":1792,"lbm_reads_lt_1ms":92,"lbm_write_time_us":2458,"lbm_writes_lt_1ms":76,"num_input_rowsets":2,"peak_mem_usage":731898,"rows_written":47900}
I20260615 08:09:12.289026 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 485063 bytes on disk
I20260615 08:09:12.290812 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:09:12.307798 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.076s user 0.059s sys 0.004s Metrics: {"bytes_written":1373647,"cfile_cache_hit":10,"cfile_cache_hit_bytes":441682,"cfile_cache_miss":74,"cfile_cache_miss_bytes":3036972,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":24,"dirs.run_cpu_time_us":84,"dirs.run_wall_time_us":382,"drs_written":1,"lbm_read_time_us":1850,"lbm_reads_lt_1ms":94,"lbm_write_time_us":2752,"lbm_writes_lt_1ms":76,"num_input_rowsets":2,"peak_mem_usage":740156,"rows_written":48550}
I20260615 08:09:12.308073 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 492023 bytes on disk
I20260615 08:09:12.308252 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:09:12.342404 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.082s user 0.059s sys 0.006s Metrics: {"bytes_written":1390079,"cfile_cache_hit":11,"cfile_cache_hit_bytes":478025,"cfile_cache_miss":73,"cfile_cache_miss_bytes":3047129,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":27,"dirs.run_cpu_time_us":95,"dirs.run_wall_time_us":649,"drs_written":1,"lbm_read_time_us":3504,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":92,"lbm_write_time_us":3342,"lbm_writes_lt_1ms":76,"num_input_rowsets":2,"peak_mem_usage":751721,"rows_written":49200,"spinlock_wait_cycles":768}
I20260615 08:09:12.342787 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 498487 bytes on disk
I20260615 08:09:12.343380 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":362,"lbm_reads_lt_1ms":4}
I20260615 08:09:12.412765 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:12.419610 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:12.432372 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.019s user 0.007s sys 0.007s Metrics: {"bytes_written":277817,"cfile_init":1,"dirs.queue_time_us":26,"dirs.run_cpu_time_us":104,"dirs.run_wall_time_us":905,"drs_written":1,"lbm_read_time_us":22,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2071,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"rows_written":9650}
I20260615 08:09:12.432675 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.014255
I20260615 08:09:12.434675 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.015s user 0.010s sys 0.003s Metrics: {"bytes_written":272486,"cfile_init":1,"dirs.queue_time_us":26,"dirs.run_cpu_time_us":90,"dirs.run_wall_time_us":408,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":730,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9450}
I20260615 08:09:12.434880 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1049941 bytes of WAL
I20260615 08:09:12.435000 15591 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:12.435077 15591 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000002 (ops 580-1157)
I20260615 08:09:12.435523 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:12.435653 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.014249
I20260615 08:09:12.444773 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:12.458891 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.014s user 0.013s sys 0.001s Metrics: {"bytes_written":275070,"cfile_init":1,"dirs.queue_time_us":29,"dirs.run_cpu_time_us":98,"dirs.run_wall_time_us":564,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":649,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9550}
I20260615 08:09:12.459098 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 87971 bytes on disk
I20260615 08:09:12.459259 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20260615 08:09:12.459384 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.014162
I20260615 08:09:12.516141 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.080s user 0.054s sys 0.019s Metrics: {"bytes_written":1635879,"cfile_cache_hit":12,"cfile_cache_hit_bytes":715923,"cfile_cache_miss":82,"cfile_cache_miss_bytes":3444675,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":151,"dirs.run_cpu_time_us":109,"dirs.run_wall_time_us":501,"drs_written":1,"lbm_read_time_us":2151,"lbm_reads_lt_1ms":106,"lbm_write_time_us":3854,"lbm_writes_lt_1ms":86,"num_input_rowsets":2,"peak_mem_usage":882598,"rows_written":58000}
I20260615 08:09:12.516731 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 591603 bytes on disk
I20260615 08:09:12.516892 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20260615 08:09:12.540333 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.081s user 0.061s sys 0.013s Metrics: {"bytes_written":1658963,"cfile_cache_hit":12,"cfile_cache_hit_bytes":720483,"cfile_cache_miss":82,"cfile_cache_miss_bytes":3492841,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":27,"dirs.run_cpu_time_us":80,"dirs.run_wall_time_us":970,"drs_written":1,"lbm_read_time_us":2074,"lbm_reads_lt_1ms":102,"lbm_write_time_us":3231,"lbm_writes_lt_1ms":88,"num_input_rowsets":2,"peak_mem_usage":895688,"rows_written":58750}
I20260615 08:09:12.540977 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 599854 bytes on disk
I20260615 08:09:12.541160 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:09:12.552963 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.120s user 0.069s sys 0.000s Metrics: {"bytes_written":1625038,"cfile_cache_hit":12,"cfile_cache_hit_bytes":716317,"cfile_cache_miss":82,"cfile_cache_miss_bytes":3410985,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":1041,"dirs.run_cpu_time_us":74,"dirs.run_wall_time_us":647,"drs_written":1,"lbm_read_time_us":3652,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":105,"lbm_write_time_us":5366,"lbm_writes_lt_1ms":86,"mutex_wait_us":493,"num_input_rowsets":2,"peak_mem_usage":877388,"rows_written":57550,"spinlock_wait_cycles":768}
I20260615 08:09:12.553159 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 587026 bytes on disk
I20260615 08:09:12.553357 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20260615 08:09:12.624338 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:12.636304 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.012s user 0.011s sys 0.000s Metrics: {"bytes_written":275022,"cfile_init":1,"dirs.queue_time_us":27,"dirs.run_cpu_time_us":120,"dirs.run_wall_time_us":556,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":650,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9550}
I20260615 08:09:12.637974 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1047506 bytes of WAL
I20260615 08:09:12.638336 15742 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:12.638468 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:12.638700 15742 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 4d643312c2624f1f9426f230a68981b0: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000002 (ops 625-1248)
I20260615 08:09:12.639246 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:12.639371 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 87913 bytes on disk
I20260615 08:09:12.639657 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4}
I20260615 08:09:12.639796 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.014303
I20260615 08:09:12.652549 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:12.673576 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.021s user 0.009s sys 0.004s Metrics: {"bytes_written":272515,"cfile_init":1,"dirs.queue_time_us":23,"dirs.run_cpu_time_us":79,"dirs.run_wall_time_us":414,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":622,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9450}
I20260615 08:09:12.673831 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.035s user 0.011s sys 0.003s Metrics: {"bytes_written":279133,"cfile_init":1,"dirs.queue_time_us":26,"dirs.run_cpu_time_us":110,"dirs.run_wall_time_us":773,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1402,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9700,"spinlock_wait_cycles":147328}
I20260615 08:09:12.674036 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 89336 bytes on disk
I20260615 08:09:12.674240 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20260615 08:09:12.674628 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.014297
I20260615 08:09:12.675170 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1047164 bytes of WAL
I20260615 08:09:12.675307 15667 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:12.675370 15667 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P a4dd9f5055864b28a3998e289ddb3760: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000002 (ops 625-1238)
I20260615 08:09:12.675779 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:12.677543 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 86992 bytes on disk
I20260615 08:09:12.677696 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":21,"lbm_reads_lt_1ms":4}
I20260615 08:09:12.677826 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.014279
I20260615 08:09:12.725814 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.086s user 0.074s sys 0.007s Metrics: {"bytes_written":1895137,"cfile_cache_hit":13,"cfile_cache_hit_bytes":794962,"cfile_cache_miss":91,"cfile_cache_miss_bytes":4023960,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":276,"dirs.run_cpu_time_us":99,"dirs.run_wall_time_us":459,"drs_written":1,"lbm_read_time_us":1932,"lbm_reads_lt_1ms":111,"lbm_write_time_us":3502,"lbm_writes_lt_1ms":99,"num_input_rowsets":2,"peak_mem_usage":1021355,"rows_written":67100,"spinlock_wait_cycles":32896}
I20260615 08:09:12.726104 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 688131 bytes on disk
I20260615 08:09:12.726260 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:09:12.807610 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.133s user 0.074s sys 0.009s Metrics: {"bytes_written":1910622,"cfile_cache_hit":12,"cfile_cache_hit_bytes":769649,"cfile_cache_miss":92,"cfile_cache_miss_bytes":4091159,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":148,"dirs.run_cpu_time_us":105,"dirs.run_wall_time_us":576,"drs_written":1,"lbm_read_time_us":2135,"lbm_reads_lt_1ms":112,"lbm_write_time_us":3557,"lbm_writes_lt_1ms":99,"num_input_rowsets":2,"peak_mem_usage":1033810,"rows_written":67700}
I20260615 08:09:12.807991 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 694460 bytes on disk
I20260615 08:09:12.808269 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":21,"lbm_reads_lt_1ms":4,"spinlock_wait_cycles":384}
I20260615 08:09:12.823642 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.146s user 0.076s sys 0.011s Metrics: {"bytes_written":1923294,"cfile_cache_hit":12,"cfile_cache_hit_bytes":769314,"cfile_cache_miss":94,"cfile_cache_miss_bytes":4128014,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":254,"dirs.run_cpu_time_us":132,"dirs.run_wall_time_us":608,"drs_written":1,"lbm_read_time_us":4091,"lbm_reads_lt_1ms":114,"lbm_write_time_us":4417,"lbm_writes_lt_1ms":99,"num_input_rowsets":2,"peak_mem_usage":1038128,"rows_written":68200,"spinlock_wait_cycles":384}
I20260615 08:09:12.823904 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 700319 bytes on disk
I20260615 08:09:12.824081 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20260615 08:09:12.848076 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:12.859253 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:12.862058 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.014s user 0.012s sys 0.000s Metrics: {"bytes_written":283037,"cfile_init":1,"dirs.queue_time_us":23,"dirs.run_cpu_time_us":136,"dirs.run_wall_time_us":716,"drs_written":1,"lbm_read_time_us":10,"lbm_reads_lt_1ms":4,"lbm_write_time_us":739,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9850}
I20260615 08:09:12.862207 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.014051
I20260615 08:09:12.874799 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:12.883471 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.024s user 0.012s sys 0.003s Metrics: {"bytes_written":280245,"cfile_init":1,"dirs.queue_time_us":21,"dirs.run_cpu_time_us":124,"dirs.run_wall_time_us":472,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1255,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9750,"spinlock_wait_cycles":768}
I20260615 08:09:12.883657 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 91162 bytes on disk
I20260615 08:09:12.883790 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4}
I20260615 08:09:12.883942 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.014046
I20260615 08:09:12.910054 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.034s user 0.015s sys 0.000s Metrics: {"bytes_written":284464,"cfile_init":1,"dirs.queue_time_us":20,"dirs.run_cpu_time_us":101,"dirs.run_wall_time_us":608,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":653,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9900}
I20260615 08:09:12.910272 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.014039
I20260615 08:09:12.964239 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.102s user 0.084s sys 0.009s Metrics: {"bytes_written":2166567,"cfile_cache_hit":12,"cfile_cache_hit_bytes":812080,"cfile_cache_miss":106,"cfile_cache_miss_bytes":4724586,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":143,"dirs.run_cpu_time_us":112,"dirs.run_wall_time_us":583,"drs_written":1,"lbm_read_time_us":2642,"lbm_reads_lt_1ms":130,"lbm_write_time_us":4216,"lbm_writes_lt_1ms":109,"num_input_rowsets":2,"peak_mem_usage":1173195,"rows_written":76950}
I20260615 08:09:12.964493 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 797997 bytes on disk
I20260615 08:09:12.964669 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20260615 08:09:13.020788 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.137s user 0.089s sys 0.009s Metrics: {"bytes_written":2183519,"cfile_cache_hit":12,"cfile_cache_hit_bytes":658762,"cfile_cache_miss":106,"cfile_cache_miss_bytes":4913682,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":67,"dirs.run_cpu_time_us":110,"dirs.run_wall_time_us":472,"drs_written":1,"lbm_read_time_us":2625,"lbm_reads_lt_1ms":126,"lbm_write_time_us":5463,"lbm_writes_lt_1ms":111,"num_input_rowsets":2,"peak_mem_usage":1180820,"rows_written":77450}
I20260615 08:09:13.021059 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 804612 bytes on disk
I20260615 08:09:13.021229 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:09:13.063206 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.153s user 0.090s sys 0.008s Metrics: {"bytes_written":2200782,"cfile_cache_hit":11,"cfile_cache_hit_bytes":480657,"cfile_cache_miss":107,"cfile_cache_miss_bytes":5139725,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":382,"dirs.run_cpu_time_us":101,"dirs.run_wall_time_us":605,"drs_written":1,"lbm_read_time_us":6123,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":130,"lbm_write_time_us":7325,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":110,"num_input_rowsets":2,"peak_mem_usage":1192761,"rows_written":78100}
I20260615 08:09:13.063508 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 811409 bytes on disk
I20260615 08:09:13.064917 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20260615 08:09:13.065919 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:13.072441 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:13.084849 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.018s user 0.007s sys 0.006s Metrics: {"bytes_written":285660,"cfile_init":1,"dirs.queue_time_us":24,"dirs.run_cpu_time_us":82,"dirs.run_wall_time_us":587,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":715,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9950}
I20260615 08:09:13.085058 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.013880
I20260615 08:09:13.085506 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:13.088744 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.016s user 0.008s sys 0.005s Metrics: {"bytes_written":280322,"cfile_init":1,"dirs.queue_time_us":64,"dirs.run_cpu_time_us":88,"dirs.run_wall_time_us":373,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":730,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9750}
I20260615 08:09:13.088910 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1049852 bytes of WAL
I20260615 08:09:13.088994 15591 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:13.089023 15591 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000003 (ops 1158-1735)
I20260615 08:09:13.089438 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:13.089556 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.013875
I20260615 08:09:13.105238 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.019s user 0.013s sys 0.000s Metrics: {"bytes_written":277784,"cfile_init":1,"dirs.queue_time_us":21,"dirs.run_cpu_time_us":95,"dirs.run_wall_time_us":634,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":672,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9650}
I20260615 08:09:13.105391 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.013869
I20260615 08:09:13.238036 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.148s user 0.092s sys 0.017s Metrics: {"bytes_written":2451314,"cfile_cache_hit":12,"cfile_cache_hit_bytes":807250,"cfile_cache_miss":118,"cfile_cache_miss_bytes":5479140,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":341,"dirs.run_cpu_time_us":110,"dirs.run_wall_time_us":642,"drs_written":1,"lbm_read_time_us":2777,"lbm_reads_lt_1ms":142,"lbm_write_time_us":6105,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":121,"num_input_rowsets":2,"peak_mem_usage":1337471,"rows_written":87200}
I20260615 08:09:13.238516 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 914018 bytes on disk
I20260615 08:09:13.238751 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20260615 08:09:13.241788 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.136s user 0.106s sys 0.005s Metrics: {"bytes_written":2470084,"cfile_cache_hit":11,"cfile_cache_hit_bytes":625495,"cfile_cache_miss":119,"cfile_cache_miss_bytes":5701915,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":2558,"dirs.run_cpu_time_us":119,"dirs.run_wall_time_us":552,"drs_written":1,"lbm_read_time_us":3988,"lbm_reads_lt_1ms":143,"lbm_write_time_us":6468,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":122,"num_input_rowsets":2,"peak_mem_usage":1348161,"rows_written":87750}
I20260615 08:09:13.242720 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 920222 bytes on disk
I20260615 08:09:13.243551 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:09:13.248215 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.163s user 0.097s sys 0.011s Metrics: {"bytes_written":2444193,"cfile_cache_hit":13,"cfile_cache_hit_bytes":842540,"cfile_cache_miss":115,"cfile_cache_miss_bytes":5419332,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":66,"dirs.run_cpu_time_us":115,"dirs.run_wall_time_us":456,"drs_written":1,"lbm_read_time_us":5843,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":138,"lbm_write_time_us":6980,"lbm_writes_lt_1ms":121,"num_input_rowsets":2,"peak_mem_usage":1332397,"rows_written":86900}
I20260615 08:09:13.248531 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 910745 bytes on disk
I20260615 08:09:13.248711 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20260615 08:09:13.289288 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:13.299474 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:13.304291 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.015s user 0.013s sys 0.000s Metrics: {"bytes_written":271118,"cfile_init":1,"dirs.queue_time_us":44,"dirs.run_cpu_time_us":130,"dirs.run_wall_time_us":602,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":751,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9400}
I20260615 08:09:13.304450 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1050530 bytes of WAL
I20260615 08:09:13.304590 15742 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:13.304625 15742 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 4d643312c2624f1f9426f230a68981b0: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000003 (ops 1249-1882)
I20260615 08:09:13.305007 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:13.305117 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.014001
I20260615 08:09:13.314726 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:13.344636 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.045s user 0.006s sys 0.009s Metrics: {"bytes_written":279108,"cfile_init":1,"dirs.queue_time_us":19,"dirs.run_cpu_time_us":125,"dirs.run_wall_time_us":620,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":771,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9700,"spinlock_wait_cycles":384}
I20260615 08:09:13.347105 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 89364 bytes on disk
I20260615 08:09:13.347227 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":24,"lbm_reads_lt_1ms":4}
I20260615 08:09:13.347328 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.013996
I20260615 08:09:13.347498 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.032s user 0.014s sys 0.000s Metrics: {"bytes_written":284305,"cfile_init":1,"dirs.queue_time_us":29,"dirs.run_cpu_time_us":95,"dirs.run_wall_time_us":525,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":681,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9900}
I20260615 08:09:13.347657 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1065125 bytes of WAL
I20260615 08:09:13.347798 15667 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:13.347838 15667 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P a4dd9f5055864b28a3998e289ddb3760: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000003 (ops 1239-1868)
I20260615 08:09:13.348212 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:13.348304 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 91284 bytes on disk
I20260615 08:09:13.348407 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4}
I20260615 08:09:13.348495 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.013987
I20260615 08:09:13.469882 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.165s user 0.102s sys 0.015s Metrics: {"bytes_written":2710706,"cfile_cache_hit":10,"cfile_cache_hit_bytes":440264,"cfile_cache_miss":130,"cfile_cache_miss_bytes":6513862,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":26,"dirs.run_cpu_time_us":104,"dirs.run_wall_time_us":630,"drs_written":1,"lbm_read_time_us":3803,"lbm_reads_lt_1ms":154,"lbm_write_time_us":6456,"lbm_writes_lt_1ms":132,"num_input_rowsets":2,"peak_mem_usage":1488992,"rows_written":96300}
I20260615 08:09:13.470170 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 1016941 bytes on disk
I20260615 08:09:13.470389 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:09:13.490192 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.142s user 0.103s sys 0.015s Metrics: {"bytes_written":2748967,"cfile_cache_hit":11,"cfile_cache_hit_bytes":628551,"cfile_cache_miss":131,"cfile_cache_miss_bytes":6423845,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":24,"dirs.run_cpu_time_us":118,"dirs.run_wall_time_us":554,"drs_written":1,"lbm_read_time_us":3149,"lbm_reads_lt_1ms":151,"lbm_write_time_us":6415,"lbm_writes_lt_1ms":135,"num_input_rowsets":2,"peak_mem_usage":1508776,"rows_written":97650,"spinlock_wait_cycles":768}
I20260615 08:09:13.490406 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 1031556 bytes on disk
I20260615 08:09:13.490532 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":31,"lbm_reads_lt_1ms":4}
I20260615 08:09:13.534461 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.187s user 0.119s sys 0.009s Metrics: {"bytes_written":2726416,"cfile_cache_hit":12,"cfile_cache_hit_bytes":802702,"cfile_cache_miss":130,"cfile_cache_miss_bytes":6193758,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":135,"dirs.run_cpu_time_us":108,"dirs.run_wall_time_us":539,"drs_written":1,"lbm_read_time_us":3660,"lbm_reads_lt_1ms":150,"lbm_write_time_us":7207,"lbm_writes_lt_1ms":133,"num_input_rowsets":2,"peak_mem_usage":1498436,"rows_written":96900,"spinlock_wait_cycles":1152}
I20260615 08:09:13.534708 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 1023251 bytes on disk
I20260615 08:09:13.534885 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:09:13.542168 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:13.555365 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:13.559484 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.017s user 0.009s sys 0.003s Metrics: {"bytes_written":269801,"cfile_init":1,"dirs.queue_time_us":23,"dirs.run_cpu_time_us":80,"dirs.run_wall_time_us":488,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":788,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9350}
I20260615 08:09:13.559623 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 85889 bytes on disk
I20260615 08:09:13.559749 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20260615 08:09:13.559834 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.013826
I20260615 08:09:13.571938 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:13.575650 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.020s user 0.002s sys 0.011s Metrics: {"bytes_written":276416,"cfile_init":1,"dirs.queue_time_us":35,"dirs.run_cpu_time_us":94,"dirs.run_wall_time_us":445,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1317,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9600}
I20260615 08:09:13.575807 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 88326 bytes on disk
I20260615 08:09:13.575959 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4}
I20260615 08:09:13.576072 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.013818
I20260615 08:09:13.599076 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.026s user 0.012s sys 0.000s Metrics: {"bytes_written":276506,"cfile_init":1,"dirs.queue_time_us":23,"dirs.run_cpu_time_us":95,"dirs.run_wall_time_us":532,"drs_written":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4,"lbm_write_time_us":562,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9600}
I20260615 08:09:13.599308 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.013729
I20260615 08:09:13.708350 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.132s user 0.123s sys 0.008s Metrics: {"bytes_written":2994572,"cfile_cache_hit":13,"cfile_cache_hit_bytes":644049,"cfile_cache_miss":139,"cfile_cache_miss_bytes":7064189,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":209,"dirs.run_cpu_time_us":118,"dirs.run_wall_time_us":688,"drs_written":1,"lbm_read_time_us":3612,"lbm_reads_lt_1ms":159,"lbm_write_time_us":5795,"lbm_writes_lt_1ms":144,"num_input_rowsets":2,"peak_mem_usage":1654527,"rows_written":106500,"spinlock_wait_cycles":384}
I20260615 08:09:13.708568 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 1130254 bytes on disk
I20260615 08:09:13.708735 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20260615 08:09:13.763613 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.164s user 0.131s sys 0.000s Metrics: {"bytes_written":3013795,"cfile_cache_hit":13,"cfile_cache_hit_bytes":648077,"cfile_cache_miss":141,"cfile_cache_miss_bytes":7113711,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":548,"dirs.run_cpu_time_us":98,"dirs.run_wall_time_us":631,"drs_written":1,"lbm_read_time_us":3517,"lbm_reads_lt_1ms":165,"lbm_write_time_us":7230,"lbm_writes_lt_1ms":145,"num_input_rowsets":2,"peak_mem_usage":1665066,"rows_written":107250,"spinlock_wait_cycles":695936}
I20260615 08:09:13.763803 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 1138188 bytes on disk
I20260615 08:09:13.764006 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20260615 08:09:13.776338 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.216s user 0.115s sys 0.014s Metrics: {"bytes_written":2968514,"cfile_cache_hit":10,"cfile_cache_hit_bytes":439413,"cfile_cache_miss":140,"cfile_cache_miss_bytes":7206691,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":180,"dirs.run_cpu_time_us":94,"dirs.run_wall_time_us":791,"drs_written":1,"lbm_read_time_us":5440,"lbm_reads_lt_1ms":160,"lbm_write_time_us":7325,"lbm_writes_lt_1ms":143,"num_input_rowsets":2,"peak_mem_usage":1639312,"rows_written":105650,"spinlock_wait_cycles":2809216}
I20260615 08:09:13.777032 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 1120891 bytes on disk
I20260615 08:09:13.778565 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20260615 08:09:13.809132 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:13.820518 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:13.829239 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.020s user 0.008s sys 0.006s Metrics: {"bytes_written":283101,"cfile_init":1,"dirs.queue_time_us":24,"dirs.run_cpu_time_us":123,"dirs.run_wall_time_us":591,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":698,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9850}
I20260615 08:09:13.829391 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 91646 bytes on disk
I20260615 08:09:13.829519 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":22,"lbm_reads_lt_1ms":4}
I20260615 08:09:13.830046 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.013348
I20260615 08:09:13.837260 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:13.847520 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.027s user 0.010s sys 0.004s Metrics: {"bytes_written":276634,"cfile_init":1,"dirs.queue_time_us":26,"dirs.run_cpu_time_us":98,"dirs.run_wall_time_us":471,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":662,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9600}
I20260615 08:09:13.847652 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 89549 bytes on disk
I20260615 08:09:13.850037 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":23,"lbm_reads_lt_1ms":4}
I20260615 08:09:13.850155 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1053119 bytes of WAL
I20260615 08:09:13.850714 15591 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:13.850754 15591 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000004 (ops 1736-2315)
I20260615 08:09:13.851145 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:13.851235 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.013339
I20260615 08:09:13.855402 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.018s user 0.012s sys 0.000s Metrics: {"bytes_written":276549,"cfile_init":1,"dirs.queue_time_us":24,"dirs.run_cpu_time_us":92,"dirs.run_wall_time_us":464,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":699,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9600}
I20260615 08:09:13.855527 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 89738 bytes on disk
I20260615 08:09:13.855646 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":21,"lbm_reads_lt_1ms":4}
I20260615 08:09:13.855737 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.013389
I20260615 08:09:13.992439 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.162s user 0.129s sys 0.011s Metrics: {"bytes_written":3242792,"cfile_cache_hit":12,"cfile_cache_hit_bytes":656061,"cfile_cache_miss":150,"cfile_cache_miss_bytes":7710471,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":275,"dirs.run_cpu_time_us":110,"dirs.run_wall_time_us":738,"drs_written":1,"lbm_read_time_us":4062,"lbm_reads_lt_1ms":170,"lbm_write_time_us":6652,"lbm_writes_lt_1ms":155,"num_input_rowsets":2,"peak_mem_usage":1797217,"rows_written":115500,"spinlock_wait_cycles":2045312}
I20260615 08:09:13.992624 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 1230706 bytes on disk
I20260615 08:09:13.992781 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:09:14.032420 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.181s user 0.136s sys 0.002s Metrics: {"bytes_written":3258458,"cfile_cache_hit":13,"cfile_cache_hit_bytes":694827,"cfile_cache_miss":149,"cfile_cache_miss_bytes":7717187,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":29,"dirs.run_cpu_time_us":76,"dirs.run_wall_time_us":772,"drs_written":1,"lbm_read_time_us":3969,"lbm_reads_lt_1ms":169,"lbm_write_time_us":7412,"lbm_writes_lt_1ms":155,"num_input_rowsets":2,"peak_mem_usage":1810517,"rows_written":116100}
I20260615 08:09:14.033605 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 1237867 bytes on disk
I20260615 08:09:14.033804 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20260615 08:09:14.063498 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.208s user 0.135s sys 0.009s Metrics: {"bytes_written":3281846,"cfile_cache_hit":11,"cfile_cache_hit_bytes":556394,"cfile_cache_miss":153,"cfile_cache_miss_bytes":7910140,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":159,"dirs.run_cpu_time_us":119,"dirs.run_wall_time_us":2765,"drs_written":1,"lbm_read_time_us":6141,"lbm_reads_lt_1ms":173,"lbm_write_time_us":10367,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":155,"num_input_rowsets":2,"peak_mem_usage":1821051,"rows_written":116850}
I20260615 08:09:14.063738 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 1246410 bytes on disk
I20260615 08:09:14.064548 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:09:14.084570 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:14.084805 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:14.101071 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.016s user 0.013s sys 0.000s Metrics: {"bytes_written":273791,"cfile_init":1,"dirs.queue_time_us":33,"dirs.run_cpu_time_us":113,"dirs.run_wall_time_us":616,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":739,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9500}
I20260615 08:09:14.101743 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 87567 bytes on disk
I20260615 08:09:14.103430 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":22,"lbm_reads_lt_1ms":4}
I20260615 08:09:14.103623 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.013578
I20260615 08:09:14.104645 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.020s user 0.013s sys 0.001s Metrics: {"bytes_written":286783,"cfile_init":1,"dirs.queue_time_us":43,"dirs.run_cpu_time_us":96,"dirs.run_wall_time_us":479,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":699,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":10000,"spinlock_wait_cycles":896}
I20260615 08:09:14.104789 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1049520 bytes of WAL
I20260615 08:09:14.104916 15742 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:14.105005 15742 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 4d643312c2624f1f9426f230a68981b0: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000004 (ops 1883-2495)
I20260615 08:09:14.105403 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:14.105891 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:14.106037 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.013580
I20260615 08:09:14.128590 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.023s user 0.015s sys 0.000s Metrics: {"bytes_written":279250,"cfile_init":1,"dirs.queue_time_us":26,"dirs.run_cpu_time_us":109,"dirs.run_wall_time_us":975,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1023,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9700}
I20260615 08:09:14.128950 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1050490 bytes of WAL
I20260615 08:09:14.129096 15667 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:14.129175 15667 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P a4dd9f5055864b28a3998e289ddb3760: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000004 (ops 1869-2470)
I20260615 08:09:14.129724 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:14.129863 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 89456 bytes on disk
I20260615 08:09:14.130028 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":22,"lbm_reads_lt_1ms":4}
I20260615 08:09:14.130157 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.013568
I20260615 08:09:14.288435 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.185s user 0.139s sys 0.012s Metrics: {"bytes_written":3527247,"cfile_cache_hit":12,"cfile_cache_hit_bytes":792213,"cfile_cache_miss":162,"cfile_cache_miss_bytes":8311953,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":185,"dirs.run_cpu_time_us":122,"dirs.run_wall_time_us":656,"drs_written":1,"lbm_read_time_us":4467,"lbm_reads_lt_1ms":182,"lbm_write_time_us":8683,"lbm_writes_lt_1ms":167,"num_input_rowsets":2,"peak_mem_usage":1964982,"rows_written":125600,"spinlock_wait_cycles":384}
I20260615 08:09:14.288669 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 1347061 bytes on disk
I20260615 08:09:14.288839 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20260615 08:09:14.319384 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:14.338152 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.208s user 0.143s sys 0.011s Metrics: {"bytes_written":3554005,"cfile_cache_hit":13,"cfile_cache_hit_bytes":826519,"cfile_cache_miss":161,"cfile_cache_miss_bytes":8347959,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":34,"dirs.run_cpu_time_us":101,"dirs.run_wall_time_us":483,"drs_written":1,"lbm_read_time_us":4765,"lbm_reads_lt_1ms":181,"lbm_write_time_us":10450,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":167,"num_input_rowsets":2,"peak_mem_usage":1978567,"rows_written":126550,"spinlock_wait_cycles":17408}
I20260615 08:09:14.339767 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 1357944 bytes on disk
I20260615 08:09:14.341114 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:09:14.341279 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:14.345949 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.026s user 0.007s sys 0.007s Metrics: {"bytes_written":276500,"cfile_init":1,"dirs.queue_time_us":47,"dirs.run_cpu_time_us":250,"dirs.run_wall_time_us":1119,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3069,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9600}
I20260615 08:09:14.346089 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 88355 bytes on disk
I20260615 08:09:14.346215 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4}
I20260615 08:09:14.346385 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.013528
I20260615 08:09:14.365947 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.025s user 0.014s sys 0.001s Metrics: {"bytes_written":271214,"cfile_init":1,"dirs.queue_time_us":26,"dirs.run_cpu_time_us":110,"dirs.run_wall_time_us":517,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":724,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9400}
I20260615 08:09:14.366211 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 86335 bytes on disk
I20260615 08:09:14.366374 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":21,"lbm_reads_lt_1ms":4}
I20260615 08:09:14.366546 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.013520
I20260615 08:09:14.382195 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.276s user 0.129s sys 0.022s Metrics: {"bytes_written":3524439,"cfile_cache_hit":15,"cfile_cache_hit_bytes":1100225,"cfile_cache_miss":159,"cfile_cache_miss_bytes":7993789,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":148,"dirs.run_cpu_time_us":112,"dirs.run_wall_time_us":530,"drs_written":1,"lbm_read_time_us":7206,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":181,"lbm_write_time_us":17004,"lbm_writes_1-10_ms":5,"lbm_writes_lt_1ms":162,"num_input_rowsets":2,"peak_mem_usage":1962857,"rows_written":125500,"spinlock_wait_cycles":384}
I20260615 08:09:14.382803 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 1345521 bytes on disk
I20260615 08:09:14.383612 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20260615 08:09:14.383787 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:14.413113 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.029s user 0.013s sys 0.005s Metrics: {"bytes_written":347562,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":117,"dirs.run_wall_time_us":621,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":781,"lbm_writes_lt_1ms":35,"peak_mem_usage":0,"rows_written":12000}
I20260615 08:09:14.413722 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.013513
I20260615 08:09:14.563252 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.197s user 0.159s sys 0.003s Metrics: {"bytes_written":3815230,"cfile_cache_hit":11,"cfile_cache_hit_bytes":614650,"cfile_cache_miss":175,"cfile_cache_miss_bytes":9255498,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":495,"dirs.run_cpu_time_us":114,"dirs.run_wall_time_us":543,"drs_written":1,"lbm_read_time_us":4779,"lbm_reads_lt_1ms":195,"lbm_write_time_us":8445,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":179,"num_input_rowsets":2,"peak_mem_usage":2131607,"rows_written":135950,"spinlock_wait_cycles":1280}
I20260615 08:09:14.563627 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 1465479 bytes on disk
I20260615 08:09:14.564962 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20260615 08:09:14.605567 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:14.628782 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.023s user 0.015s sys 0.000s Metrics: {"bytes_written":289653,"cfile_init":1,"dirs.queue_time_us":23,"dirs.run_cpu_time_us":104,"dirs.run_wall_time_us":595,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":656,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":10100}
I20260615 08:09:14.628995 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 93065 bytes on disk
I20260615 08:09:14.629266 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4}
I20260615 08:09:14.629431 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.013451
I20260615 08:09:14.639107 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.225s user 0.155s sys 0.009s Metrics: {"bytes_written":3859138,"cfile_cache_hit":13,"cfile_cache_hit_bytes":875934,"cfile_cache_miss":175,"cfile_cache_miss_bytes":9104764,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":157,"dirs.run_cpu_time_us":102,"dirs.run_wall_time_us":871,"drs_written":1,"lbm_read_time_us":3870,"lbm_reads_lt_1ms":199,"lbm_write_time_us":8723,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":181,"num_input_rowsets":2,"peak_mem_usage":2155840,"rows_written":137500,"spinlock_wait_cycles":23384832}
I20260615 08:09:14.639264 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:14.644150 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.298s user 0.148s sys 0.015s Metrics: {"bytes_written":3796060,"cfile_cache_hit":12,"cfile_cache_hit_bytes":648998,"cfile_cache_miss":174,"cfile_cache_miss_bytes":9168708,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":159,"dirs.run_cpu_time_us":108,"dirs.run_wall_time_us":857,"drs_written":1,"lbm_read_time_us":4583,"lbm_reads_lt_1ms":194,"lbm_write_time_us":9245,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":178,"num_input_rowsets":2,"peak_mem_usage":2120872,"rows_written":135200,"spinlock_wait_cycles":8722304}
I20260615 08:09:14.644284 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:14.660372 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.021s user 0.009s sys 0.004s Metrics: {"bytes_written":284348,"cfile_init":1,"dirs.queue_time_us":24,"dirs.run_cpu_time_us":99,"dirs.run_wall_time_us":3524,"drs_written":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4,"lbm_write_time_us":594,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9900}
I20260615 08:09:14.660544 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 1573767 bytes on disk
I20260615 08:09:14.660699 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":37,"lbm_reads_lt_1ms":8}
I20260615 08:09:14.660786 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.013436
I20260615 08:09:14.666241 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.022s user 0.014s sys 0.003s Metrics: {"bytes_written":355942,"cfile_init":1,"dirs.queue_time_us":26,"dirs.run_cpu_time_us":85,"dirs.run_wall_time_us":486,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1333,"lbm_writes_lt_1ms":35,"peak_mem_usage":0,"rows_written":12300}
I20260615 08:09:14.666393 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1051659 bytes of WAL
I20260615 08:09:14.666591 15591 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:14.666628 15591 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000005 (ops 2316-2894)
I20260615 08:09:14.667021 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"spinlock_wait_cycles":1408}
I20260615 08:09:14.667105 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 1570711 bytes on disk
I20260615 08:09:14.667236 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":38,"lbm_reads_lt_1ms":8}
I20260615 08:09:14.667332 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.013435
I20260615 08:09:14.839151 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.178s user 0.162s sys 0.013s Metrics: {"bytes_written":4134373,"cfile_cache_hit":10,"cfile_cache_hit_bytes":450512,"cfile_cache_miss":192,"cfile_cache_miss_bytes":10265658,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":173,"dirs.run_cpu_time_us":125,"dirs.run_wall_time_us":617,"drs_written":1,"lbm_read_time_us":5583,"lbm_reads_lt_1ms":212,"lbm_write_time_us":7746,"lbm_writes_lt_1ms":193,"num_input_rowsets":2,"peak_mem_usage":2318806,"rows_written":147400,"spinlock_wait_cycles":1792}
I20260615 08:09:14.839339 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 1594416 bytes on disk
I20260615 08:09:14.839454 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:09:14.898636 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.269s user 0.162s sys 0.011s Metrics: {"bytes_written":4095847,"cfile_cache_hit":14,"cfile_cache_hit_bytes":1006123,"cfile_cache_miss":186,"cfile_cache_miss_bytes":9610639,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":185,"dirs.run_cpu_time_us":88,"dirs.run_wall_time_us":610,"drs_written":1,"lbm_read_time_us":7499,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":205,"lbm_write_time_us":13803,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":191,"num_input_rowsets":2,"peak_mem_usage":2295022,"rows_written":146050,"spinlock_wait_cycles":768}
I20260615 08:09:14.898833 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:14.900434 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.233s user 0.163s sys 0.020s Metrics: {"bytes_written":4137293,"cfile_cache_hit":14,"cfile_cache_hit_bytes":729930,"cfile_cache_miss":186,"cfile_cache_miss_bytes":9988952,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":46,"dirs.run_cpu_time_us":134,"dirs.run_wall_time_us":472,"drs_written":1,"lbm_read_time_us":6782,"lbm_reads_lt_1ms":206,"lbm_write_time_us":9946,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":192,"num_input_rowsets":2,"peak_mem_usage":2318031,"rows_written":147500}
I20260615 08:09:14.900705 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 1595146 bytes on disk
I20260615 08:09:14.900874 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:09:14.914139 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.015s user 0.014s sys 0.000s Metrics: {"bytes_written":290916,"cfile_init":1,"dirs.queue_time_us":57,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":844,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":10150}
I20260615 08:09:14.914309 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1043114 bytes of WAL
I20260615 08:09:14.914475 15667 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:14.914542 15667 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P a4dd9f5055864b28a3998e289ddb3760: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000005 (ops 2471-3094)
I20260615 08:09:14.914963 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:14.915102 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.013231
I20260615 08:09:14.920469 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:14.921373 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:14.943506 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.022s user 0.014s sys 0.000s Metrics: {"bytes_written":277694,"cfile_init":1,"dirs.queue_time_us":27,"dirs.run_cpu_time_us":120,"dirs.run_wall_time_us":541,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":758,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9650}
I20260615 08:09:14.943714 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.013220
I20260615 08:09:14.951968 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.031s user 0.012s sys 0.002s Metrics: {"bytes_written":277826,"cfile_init":1,"dirs.queue_time_us":23,"dirs.run_cpu_time_us":83,"dirs.run_wall_time_us":484,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2270,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"rows_written":9650}
I20260615 08:09:14.952124 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1048208 bytes of WAL
I20260615 08:09:14.954368 15742 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:14.954411 15742 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 4d643312c2624f1f9426f230a68981b0: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000005 (ops 2496-3142)
I20260615 08:09:14.955281 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:14.955475 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.013221
I20260615 08:09:15.194257 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.279s user 0.172s sys 0.025s Metrics: {"bytes_written":4377881,"cfile_cache_hit":15,"cfile_cache_hit_bytes":1177224,"cfile_cache_miss":197,"cfile_cache_miss_bytes":10184758,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":379,"dirs.run_cpu_time_us":118,"dirs.run_wall_time_us":638,"drs_written":1,"lbm_read_time_us":10446,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":224,"lbm_write_time_us":11574,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":203,"num_input_rowsets":2,"peak_mem_usage":2458247,"rows_written":156200,"spinlock_wait_cycles":1380608}
I20260615 08:09:15.194511 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:15.232110 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.036s user 0.021s sys 0.000s Metrics: {"bytes_written":423453,"cfile_init":1,"dirs.queue_time_us":198,"dirs.run_cpu_time_us":115,"dirs.run_wall_time_us":537,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1388,"lbm_writes_lt_1ms":38,"peak_mem_usage":0,"rows_written":14750}
I20260615 08:09:15.232998 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.013179
I20260615 08:09:15.305272 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.361s user 0.180s sys 0.009s Metrics: {"bytes_written":4401889,"cfile_cache_hit":14,"cfile_cache_hit_bytes":993506,"cfile_cache_miss":198,"cfile_cache_miss_bytes":10439896,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":191,"dirs.run_cpu_time_us":597,"dirs.run_wall_time_us":5595,"drs_written":1,"lbm_read_time_us":12780,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":221,"lbm_write_time_us":15194,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":203,"num_input_rowsets":2,"peak_mem_usage":2475832,"rows_written":157150,"spinlock_wait_cycles":768}
I20260615 08:09:15.305913 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.937278
I20260615 08:09:15.335282 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.029s user 0.021s sys 0.004s Metrics: {"bytes_written":574797,"cfile_init":1,"dirs.queue_time_us":22,"dirs.run_cpu_time_us":111,"dirs.run_wall_time_us":574,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1238,"lbm_writes_lt_1ms":44,"peak_mem_usage":0,"rows_written":20200}
I20260615 08:09:15.335544 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1124268 bytes of WAL
I20260615 08:09:15.335695 15591 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:15.335794 15591 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000006 (ops 2895-3513)
I20260615 08:09:15.336164 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:15.336273 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 1897803 bytes on disk
I20260615 08:09:15.336409 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":31,"lbm_reads_lt_1ms":8}
I20260615 08:09:15.336534 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.013116
I20260615 08:09:15.536095 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.580s user 0.173s sys 0.023s Metrics: {"bytes_written":4399414,"cfile_cache_hit":15,"cfile_cache_hit_bytes":1165495,"cfile_cache_miss":197,"cfile_cache_miss_bytes":10260717,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":16418,"dirs.run_cpu_time_us":108,"dirs.run_wall_time_us":676,"drs_written":1,"lbm_read_time_us":11226,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":220,"lbm_write_time_us":36816,"lbm_writes_1-10_ms":8,"lbm_writes_lt_1ms":196,"num_input_rowsets":2,"peak_mem_usage":2474207,"rows_written":157050,"thread_start_us":310,"threads_started":6}
I20260615 08:09:15.536273 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=2.929465
I20260615 08:09:15.594213 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.258s user 0.206s sys 0.015s Metrics: {"bytes_written":4966422,"cfile_cache_hit":11,"cfile_cache_hit_bytes":586779,"cfile_cache_miss":225,"cfile_cache_miss_bytes":12303829,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":158,"dirs.run_cpu_time_us":349,"dirs.run_wall_time_us":2724,"drs_written":1,"lbm_read_time_us":8783,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":244,"lbm_write_time_us":10510,"lbm_writes_lt_1ms":227,"num_input_rowsets":2,"peak_mem_usage":2793497,"rows_written":177350,"spinlock_wait_cycles":2722176}
I20260615 08:09:15.594455 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:15.611194 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.071s user 0.034s sys 0.001s Metrics: {"bytes_written":813305,"cfile_init":1,"dirs.queue_time_us":26,"dirs.run_cpu_time_us":91,"dirs.run_wall_time_us":410,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2405,"lbm_writes_lt_1ms":54,"peak_mem_usage":0,"rows_written":28600}
I20260615 08:09:15.611459 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.013045
I20260615 08:09:15.625186 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.027s user 0.017s sys 0.000s Metrics: {"bytes_written":325440,"cfile_init":1,"dirs.queue_time_us":34,"dirs.run_cpu_time_us":89,"dirs.run_wall_time_us":547,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":962,"lbm_writes_lt_1ms":34,"peak_mem_usage":0,"rows_written":11300}
I20260615 08:09:15.625440 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.012995
I20260615 08:09:15.644852 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.410s user 0.195s sys 0.014s Metrics: {"bytes_written":4785475,"cfile_cache_hit":12,"cfile_cache_hit_bytes":743498,"cfile_cache_miss":218,"cfile_cache_miss_bytes":11691056,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":690,"dirs.run_cpu_time_us":111,"dirs.run_wall_time_us":556,"drs_written":1,"lbm_read_time_us":12623,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":244,"lbm_write_time_us":16860,"lbm_writes_1-10_ms":4,"lbm_writes_lt_1ms":216,"num_input_rowsets":2,"peak_mem_usage":2694963,"rows_written":170950,"spinlock_wait_cycles":1152}
I20260615 08:09:15.645363 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.937278
I20260615 08:09:15.687644 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.042s user 0.023s sys 0.002s Metrics: {"bytes_written":565955,"cfile_init":1,"dirs.queue_time_us":22,"dirs.run_cpu_time_us":116,"dirs.run_wall_time_us":625,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1395,"lbm_writes_lt_1ms":44,"peak_mem_usage":0,"rows_written":19850}
I20260615 08:09:15.687927 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1073337 bytes of WAL
I20260615 08:09:15.688099 15667 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:15.688176 15667 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P a4dd9f5055864b28a3998e289ddb3760: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000006 (ops 3095-3715)
I20260615 08:09:15.688705 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:15.688874 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 2053356 bytes on disk
I20260615 08:09:15.689082 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":32,"lbm_reads_lt_1ms":8}
I20260615 08:09:15.689605 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.012978
I20260615 08:09:15.895525 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.284s user 0.210s sys 0.010s Metrics: {"bytes_written":5195291,"cfile_cache_hit":16,"cfile_cache_hit_bytes":1261604,"cfile_cache_miss":230,"cfile_cache_miss_bytes":12225138,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":141,"dirs.run_cpu_time_us":127,"dirs.run_wall_time_us":675,"drs_written":1,"lbm_read_time_us":8624,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":256,"lbm_write_time_us":10811,"lbm_writes_lt_1ms":237,"num_input_rowsets":2,"peak_mem_usage":2919954,"rows_written":185650}
I20260615 08:09:15.896535 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 2031817 bytes on disk
I20260615 08:09:15.897046 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20260615 08:09:15.897183 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:15.920742 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.023s user 0.015s sys 0.003s Metrics: {"bytes_written":382261,"cfile_init":1,"dirs.queue_time_us":27,"dirs.run_cpu_time_us":90,"dirs.run_wall_time_us":568,"drs_written":1,"lbm_read_time_us":41,"lbm_reads_lt_1ms":4,"lbm_write_time_us":809,"lbm_writes_lt_1ms":36,"peak_mem_usage":0,"rows_written":13300}
I20260615 08:09:15.920996 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1061344 bytes of WAL
I20260615 08:09:15.921617 15742 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:15.921717 15742 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 4d643312c2624f1f9426f230a68981b0: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000006 (ops 3143-3796)
I20260615 08:09:15.922149 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:15.922271 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.012678
I20260615 08:09:15.971547 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.282s user 0.205s sys 0.022s Metrics: {"bytes_written":5339630,"cfile_cache_hit":14,"cfile_cache_hit_bytes":965064,"cfile_cache_miss":238,"cfile_cache_miss_bytes":12920210,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":418,"dirs.run_cpu_time_us":85,"dirs.run_wall_time_us":387,"drs_written":1,"lbm_read_time_us":7003,"lbm_reads_lt_1ms":258,"lbm_write_time_us":14556,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":242,"num_input_rowsets":2,"peak_mem_usage":3010750,"rows_written":190800,"spinlock_wait_cycles":768}
I20260615 08:09:15.971879 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 2090752 bytes on disk
I20260615 08:09:15.972223 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:09:15.972409 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:15.988329 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.016s user 0.014s sys 0.000s Metrics: {"bytes_written":304134,"cfile_init":1,"dirs.queue_time_us":346,"dirs.run_cpu_time_us":94,"dirs.run_wall_time_us":427,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":663,"lbm_writes_lt_1ms":33,"peak_mem_usage":0,"rows_written":10500}
I20260615 08:09:15.988590 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 98017 bytes on disk
I20260615 08:09:15.988808 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":23,"lbm_reads_lt_1ms":4,"spinlock_wait_cycles":896}
I20260615 08:09:15.988992 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.012648
I20260615 08:09:16.000504 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.375s user 0.216s sys 0.016s Metrics: {"bytes_written":5280643,"cfile_cache_hit":13,"cfile_cache_hit_bytes":853522,"cfile_cache_miss":235,"cfile_cache_miss_bytes":12899142,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":167,"dirs.run_cpu_time_us":462,"dirs.run_wall_time_us":2976,"drs_written":1,"lbm_read_time_us":10548,"lbm_reads_lt_1ms":263,"lbm_write_time_us":16709,"lbm_writes_lt_1ms":241,"num_input_rowsets":2,"peak_mem_usage":2986020,"rows_written":188650,"spinlock_wait_cycles":3840}
I20260615 08:09:16.000914 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 2066672 bytes on disk
I20260615 08:09:16.001127 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:09:16.001358 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:16.032027 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.031s user 0.018s sys 0.001s Metrics: {"bytes_written":383674,"cfile_init":1,"dirs.queue_time_us":20,"dirs.run_cpu_time_us":114,"dirs.run_wall_time_us":656,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1771,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":35,"peak_mem_usage":0,"rows_written":13350}
I20260615 08:09:16.032727 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.012701
I20260615 08:09:16.226204 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.304s user 0.224s sys 0.008s Metrics: {"bytes_written":5565852,"cfile_cache_hit":11,"cfile_cache_hit_bytes":685908,"cfile_cache_miss":249,"cfile_cache_miss_bytes":13816072,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":496,"dirs.run_cpu_time_us":114,"dirs.run_wall_time_us":718,"drs_written":1,"lbm_read_time_us":7762,"lbm_reads_lt_1ms":273,"lbm_write_time_us":12336,"lbm_writes_lt_1ms":255,"num_input_rowsets":2,"peak_mem_usage":3151384,"rows_written":198950,"spinlock_wait_cycles":1920}
I20260615 08:09:16.226473 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 2183351 bytes on disk
I20260615 08:09:16.226671 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20260615 08:09:16.227015 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:16.241703 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.253s user 0.223s sys 0.016s Metrics: {"bytes_written":5630205,"cfile_cache_hit":11,"cfile_cache_hit_bytes":631674,"cfile_cache_miss":251,"cfile_cache_miss_bytes":14051448,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":374,"dirs.run_cpu_time_us":119,"dirs.run_wall_time_us":542,"drs_written":1,"lbm_read_time_us":6922,"lbm_reads_lt_1ms":271,"lbm_write_time_us":10619,"lbm_writes_lt_1ms":257,"num_input_rowsets":2,"peak_mem_usage":3194025,"rows_written":201300,"spinlock_wait_cycles":2176}
I20260615 08:09:16.242686 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 2210600 bytes on disk
I20260615 08:09:16.244508 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20260615 08:09:16.251045 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.024s user 0.015s sys 0.000s Metrics: {"bytes_written":285602,"cfile_init":1,"dirs.queue_time_us":95,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1121,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9950}
I20260615 08:09:16.251242 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.012656
I20260615 08:09:16.275074 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:16.301312 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.026s user 0.012s sys 0.001s Metrics: {"bytes_written":273704,"cfile_init":1,"dirs.queue_time_us":23,"dirs.run_cpu_time_us":109,"dirs.run_wall_time_us":623,"drs_written":1,"lbm_read_time_us":21,"lbm_reads_lt_1ms":4,"lbm_write_time_us":705,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9500,"spinlock_wait_cycles":156544}
I20260615 08:09:16.301904 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.012635
I20260615 08:09:16.355046 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.322s user 0.218s sys 0.028s Metrics: {"bytes_written":5652069,"cfile_cache_hit":11,"cfile_cache_hit_bytes":686739,"cfile_cache_miss":253,"cfile_cache_miss_bytes":14045803,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":31,"dirs.run_cpu_time_us":88,"dirs.run_wall_time_us":513,"drs_written":1,"lbm_read_time_us":15561,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":276,"lbm_write_time_us":12744,"lbm_writes_lt_1ms":258,"num_input_rowsets":2,"peak_mem_usage":3199237,"rows_written":202000,"spinlock_wait_cycles":3200}
I20260615 08:09:16.355342 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:16.381494 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.026s user 0.016s sys 0.003s Metrics: {"bytes_written":357299,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":85,"dirs.run_wall_time_us":522,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":750,"lbm_writes_lt_1ms":35,"peak_mem_usage":0,"rows_written":12350,"spinlock_wait_cycles":384}
I20260615 08:09:16.381774 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1082540 bytes of WAL
I20260615 08:09:16.381901 15591 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:16.381973 15591 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000007 (ops 3514-4109)
I20260615 08:09:16.382882 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:16.383045 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.012616
I20260615 08:09:16.662597 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.279s user 0.219s sys 0.034s Metrics: {"bytes_written":5994174,"cfile_cache_hit":12,"cfile_cache_hit_bytes":705032,"cfile_cache_miss":268,"cfile_cache_miss_bytes":14932680,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":157,"dirs.run_cpu_time_us":117,"dirs.run_wall_time_us":588,"drs_written":1,"lbm_read_time_us":7965,"lbm_reads_lt_1ms":296,"lbm_write_time_us":12429,"lbm_writes_lt_1ms":273,"num_input_rowsets":2,"peak_mem_usage":3405868,"rows_written":214350,"spinlock_wait_cycles":768,"thread_start_us":55,"threads_started":1}
I20260615 08:09:16.662892 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 2360984 bytes on disk
I20260615 08:09:16.663116 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:09:16.663280 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:16.684108 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.021s user 0.016s sys 0.000s Metrics: {"bytes_written":325351,"cfile_init":1,"dirs.queue_time_us":22,"dirs.run_cpu_time_us":94,"dirs.run_wall_time_us":1880,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1860,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":33,"peak_mem_usage":0,"rows_written":11300}
I20260615 08:09:16.684377 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.012468
I20260615 08:09:16.752403 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.501s user 0.225s sys 0.020s Metrics: {"bytes_written":5844454,"cfile_cache_hit":14,"cfile_cache_hit_bytes":989531,"cfile_cache_miss":262,"cfile_cache_miss_bytes":14248775,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":48,"dirs.run_cpu_time_us":358,"dirs.run_wall_time_us":12244,"drs_written":1,"lbm_read_time_us":15258,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":285,"lbm_write_time_us":31141,"lbm_writes_1-10_ms":5,"lbm_writes_lt_1ms":262,"num_input_rowsets":2,"peak_mem_usage":3314761,"rows_written":208900,"spinlock_wait_cycles":6144,"thread_start_us":212,"threads_started":5}
I20260615 08:09:16.752729 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 2298668 bytes on disk
I20260615 08:09:16.752969 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20260615 08:09:16.753158 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.937278
I20260615 08:09:16.783353 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.030s user 0.021s sys 0.004s Metrics: {"bytes_written":564435,"cfile_init":1,"dirs.queue_time_us":22,"dirs.run_cpu_time_us":92,"dirs.run_wall_time_us":462,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1589,"lbm_writes_lt_1ms":44,"peak_mem_usage":0,"rows_written":19800}
I20260615 08:09:16.783622 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1048728 bytes of WAL
I20260615 08:09:16.783823 15742 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:16.783911 15742 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 4d643312c2624f1f9426f230a68981b0: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000007 (ops 3797-4433)
I20260615 08:09:16.784711 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:16.784857 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.012505
I20260615 08:09:16.832240 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.530s user 0.228s sys 0.021s Metrics: {"bytes_written":5894644,"cfile_cache_hit":15,"cfile_cache_hit_bytes":1147440,"cfile_cache_miss":263,"cfile_cache_miss_bytes":14233666,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":50,"dirs.run_cpu_time_us":174,"dirs.run_wall_time_us":748,"drs_written":1,"lbm_read_time_us":17415,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":285,"lbm_write_time_us":17595,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":267,"num_input_rowsets":2,"peak_mem_usage":3352685,"rows_written":210800,"spinlock_wait_cycles":9369984,"thread_start_us":254,"threads_started":5}
I20260615 08:09:16.832581 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 2320374 bytes on disk
I20260615 08:09:16.832768 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:09:16.832937 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.937278
I20260615 08:09:16.931879 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.099s user 0.026s sys 0.000s Metrics: {"bytes_written":572410,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":127,"dirs.run_wall_time_us":472,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":5031,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":42,"peak_mem_usage":0,"rows_written":20100}
I20260615 08:09:16.932173 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1062237 bytes of WAL
I20260615 08:09:16.932279 15667 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:16.932333 15667 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P a4dd9f5055864b28a3998e289ddb3760: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000007 (ops 3716-4333)
I20260615 08:09:16.932965 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:16.933938 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 191463 bytes on disk
I20260615 08:09:16.934096 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":23,"lbm_reads_lt_1ms":4}
I20260615 08:09:16.934247 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.012542
I20260615 08:09:16.959638 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.275s user 0.244s sys 0.020s Metrics: {"bytes_written":6304180,"cfile_cache_hit":12,"cfile_cache_hit_bytes":681459,"cfile_cache_miss":284,"cfile_cache_miss_bytes":15791881,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":148,"dirs.run_cpu_time_us":564,"dirs.run_wall_time_us":3011,"drs_written":1,"lbm_read_time_us":6339,"lbm_reads_lt_1ms":308,"lbm_write_time_us":11030,"lbm_writes_lt_1ms":285,"num_input_rowsets":2,"peak_mem_usage":3590526,"rows_written":225650,"spinlock_wait_cycles":384}
I20260615 08:09:16.960035 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 2490645 bytes on disk
I20260615 08:09:16.960182 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:09:16.990748 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:17.009537 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.019s user 0.014s sys 0.000s Metrics: {"bytes_written":277823,"cfile_init":1,"dirs.queue_time_us":27,"dirs.run_cpu_time_us":104,"dirs.run_wall_time_us":868,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":639,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9650}
I20260615 08:09:17.009774 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1051607 bytes of WAL
I20260615 08:09:17.009948 15591 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:17.010025 15591 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000008 (ops 4110-4688)
I20260615 08:09:17.011173 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:17.011312 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 89951 bytes on disk
I20260615 08:09:17.011756 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:09:17.011888 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.012503
I20260615 08:09:17.075234 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.290s user 0.230s sys 0.030s Metrics: {"bytes_written":6391292,"cfile_cache_hit":12,"cfile_cache_hit_bytes":754485,"cfile_cache_miss":288,"cfile_cache_miss_bytes":15923791,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":52,"dirs.run_cpu_time_us":101,"dirs.run_wall_time_us":596,"drs_written":1,"lbm_read_time_us":7257,"lbm_reads_lt_1ms":312,"lbm_write_time_us":12844,"lbm_writes_lt_1ms":289,"num_input_rowsets":2,"peak_mem_usage":3633226,"rows_written":228700,"spinlock_wait_cycles":335744}
I20260615 08:09:17.075537 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 2526141 bytes on disk
I20260615 08:09:17.075897 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20260615 08:09:17.116580 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:17.142925 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.026s user 0.014s sys 0.000s Metrics: {"bytes_written":276448,"cfile_init":1,"dirs.queue_time_us":21,"dirs.run_cpu_time_us":142,"dirs.run_wall_time_us":753,"drs_written":1,"lbm_read_time_us":231,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1517,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9600}
I20260615 08:09:17.143131 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.012430
I20260615 08:09:17.250834 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.316s user 0.245s sys 0.025s Metrics: {"bytes_written":6455899,"cfile_cache_hit":11,"cfile_cache_hit_bytes":694921,"cfile_cache_miss":291,"cfile_cache_miss_bytes":16140827,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":22,"dirs.run_cpu_time_us":123,"dirs.run_wall_time_us":746,"drs_written":1,"lbm_read_time_us":8210,"lbm_reads_lt_1ms":311,"lbm_write_time_us":16365,"lbm_writes_lt_1ms":292,"num_input_rowsets":2,"peak_mem_usage":3668675,"rows_written":230900}
I20260615 08:09:17.251186 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:17.274684 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.021s user 0.005s sys 0.011s Metrics: {"bytes_written":304114,"cfile_init":1,"dirs.queue_time_us":22,"dirs.run_cpu_time_us":102,"dirs.run_wall_time_us":477,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":708,"lbm_writes_lt_1ms":33,"peak_mem_usage":0,"rows_written":10500}
I20260615 08:09:17.274971 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 2649701 bytes on disk
I20260615 08:09:17.275211 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":35,"lbm_reads_lt_1ms":8}
I20260615 08:09:17.275375 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.012397
I20260615 08:09:17.343246 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.331s user 0.250s sys 0.032s Metrics: {"bytes_written":6576313,"cfile_cache_hit":15,"cfile_cache_hit_bytes":1145713,"cfile_cache_miss":291,"cfile_cache_miss_bytes":16040971,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":22,"dirs.run_cpu_time_us":103,"dirs.run_wall_time_us":565,"drs_written":1,"lbm_read_time_us":8422,"lbm_reads_lt_1ms":311,"lbm_write_time_us":14532,"lbm_writes_lt_1ms":297,"num_input_rowsets":2,"peak_mem_usage":3747333,"rows_written":235300,"spinlock_wait_cycles":384}
I20260615 08:09:17.343567 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 2602263 bytes on disk
I20260615 08:09:17.343760 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20260615 08:09:17.396840 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:17.430171 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.033s user 0.014s sys 0.000s Metrics: {"bytes_written":275024,"cfile_init":1,"dirs.queue_time_us":22,"dirs.run_cpu_time_us":107,"dirs.run_wall_time_us":575,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":4570,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":30,"peak_mem_usage":0,"rows_written":9550}
I20260615 08:09:17.430457 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 87821 bytes on disk
I20260615 08:09:17.430716 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":24,"lbm_reads_lt_1ms":4}
I20260615 08:09:17.430871 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.012285
I20260615 08:09:17.497733 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.353s user 0.269s sys 0.007s Metrics: {"bytes_written":6658822,"cfile_cache_hit":12,"cfile_cache_hit_bytes":780469,"cfile_cache_miss":298,"cfile_cache_miss_bytes":16632277,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":229,"dirs.run_cpu_time_us":487,"dirs.run_wall_time_us":3016,"drs_written":1,"lbm_read_time_us":12211,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":321,"lbm_write_time_us":16400,"lbm_writes_lt_1ms":300,"num_input_rowsets":2,"peak_mem_usage":3799431,"rows_written":238300,"spinlock_wait_cycles":384}
I20260615 08:09:17.498049 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 2636543 bytes on disk
I20260615 08:09:17.498284 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:09:17.509475 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:17.529126 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.019s user 0.014s sys 0.000s Metrics: {"bytes_written":276393,"cfile_init":1,"dirs.queue_time_us":19,"dirs.run_cpu_time_us":109,"dirs.run_wall_time_us":463,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":703,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9600}
I20260615 08:09:17.529471 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 88378 bytes on disk
I20260615 08:09:17.529954 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20260615 08:09:17.530115 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.012265
I20260615 08:09:17.565616 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.290s user 0.258s sys 0.023s Metrics: {"bytes_written":6744854,"cfile_cache_hit":13,"cfile_cache_hit_bytes":670444,"cfile_cache_miss":299,"cfile_cache_miss_bytes":16969300,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":593,"dirs.run_cpu_time_us":90,"dirs.run_wall_time_us":4816,"drs_written":1,"lbm_read_time_us":7674,"lbm_reads_lt_1ms":319,"lbm_write_time_us":12224,"lbm_writes_lt_1ms":304,"num_input_rowsets":2,"peak_mem_usage":3848905,"rows_written":241400,"spinlock_wait_cycles":2944}
I20260615 08:09:17.565850 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 2672851 bytes on disk
I20260615 08:09:17.566313 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:09:17.607627 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:17.682101 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.074s user 0.008s sys 0.007s Metrics: {"bytes_written":275119,"cfile_init":1,"dirs.queue_time_us":398,"dirs.run_cpu_time_us":125,"dirs.run_wall_time_us":730,"drs_written":1,"lbm_read_time_us":191,"lbm_reads_lt_1ms":4,"lbm_write_time_us":4259,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":30,"peak_mem_usage":0,"rows_written":9550}
I20260615 08:09:17.682521 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1053473 bytes of WAL
I20260615 08:09:17.682613 15667 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:17.682672 15667 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P a4dd9f5055864b28a3998e289ddb3760: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000008 (ops 4334-4930)
I20260615 08:09:17.683063 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:17.683244 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 88024 bytes on disk
I20260615 08:09:17.685014 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20260615 08:09:17.685199 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.012232
I20260615 08:09:17.925209 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.494s user 0.278s sys 0.026s Metrics: {"bytes_written":6841985,"cfile_cache_hit":12,"cfile_cache_hit_bytes":778697,"cfile_cache_miss":306,"cfile_cache_miss_bytes":17116239,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":835,"dirs.run_cpu_time_us":117,"dirs.run_wall_time_us":551,"drs_written":1,"lbm_read_time_us":12762,"lbm_reads_lt_1ms":326,"lbm_write_time_us":21755,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":307,"num_input_rowsets":2,"peak_mem_usage":3904258,"rows_written":244850,"spinlock_wait_cycles":2944,"thread_start_us":240,"threads_started":5}
I20260615 08:09:17.925544 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.937278
I20260615 08:09:17.956007 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.426s user 0.282s sys 0.017s Metrics: {"bytes_written":6924562,"cfile_cache_hit":13,"cfile_cache_hit_bytes":809414,"cfile_cache_miss":307,"cfile_cache_miss_bytes":17306490,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":366,"dirs.run_cpu_time_us":128,"dirs.run_wall_time_us":469,"drs_written":1,"lbm_read_time_us":10796,"lbm_reads_lt_1ms":327,"lbm_write_time_us":16000,"lbm_writes_lt_1ms":310,"num_input_rowsets":2,"peak_mem_usage":3955422,"rows_written":247900,"spinlock_wait_cycles":1152}
I20260615 08:09:17.956306 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 2747997 bytes on disk
I20260615 08:09:17.956511 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:09:17.957216 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:17.989615 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.031s user 0.017s sys 0.007s Metrics: {"bytes_written":534452,"cfile_init":1,"dirs.queue_time_us":41,"dirs.run_cpu_time_us":120,"dirs.run_wall_time_us":540,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1120,"lbm_writes_lt_1ms":42,"peak_mem_usage":0,"rows_written":18800}
I20260615 08:09:17.990190 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1060366 bytes of WAL
I20260615 08:09:17.990300 15742 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:17.990379 15742 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 4d643312c2624f1f9426f230a68981b0: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000008 (ops 4434-5044)
I20260615 08:09:17.991078 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:17.992000 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 178292 bytes on disk
I20260615 08:09:17.992205 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":21,"lbm_reads_lt_1ms":4}
I20260615 08:09:17.992455 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.012032
I20260615 08:09:17.999037 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.073s user 0.022s sys 0.004s Metrics: {"bytes_written":594691,"cfile_init":1,"dirs.queue_time_us":2653,"dirs.run_cpu_time_us":83,"dirs.run_wall_time_us":394,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":8386,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":43,"peak_mem_usage":0,"rows_written":20800}
I20260615 08:09:17.999655 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1071401 bytes of WAL
I20260615 08:09:17.999835 15591 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:17.999917 15591 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000009 (ops 4689-5278)
I20260615 08:09:18.001724 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.002s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:18.001873 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 2910875 bytes on disk
I20260615 08:09:18.002111 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":49,"lbm_reads_lt_1ms":8}
I20260615 08:09:18.002282 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.012187
I20260615 08:09:18.324265 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.636s user 0.255s sys 0.042s Metrics: {"bytes_written":7008452,"cfile_cache_hit":16,"cfile_cache_hit_bytes":1254556,"cfile_cache_miss":308,"cfile_cache_miss_bytes":17086252,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":11030,"dirs.run_cpu_time_us":118,"dirs.run_wall_time_us":1171,"drs_written":1,"lbm_read_time_us":12486,"lbm_reads_lt_1ms":328,"lbm_write_time_us":36070,"lbm_writes_1-10_ms":7,"lbm_writes_lt_1ms":308,"num_input_rowsets":2,"peak_mem_usage":4003375,"rows_written":250950,"thread_start_us":316,"threads_started":6}
I20260615 08:09:18.324566 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=2.929465
I20260615 08:09:18.350826 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.358s user 0.284s sys 0.025s Metrics: {"bytes_written":7443405,"cfile_cache_hit":13,"cfile_cache_hit_bytes":916952,"cfile_cache_miss":327,"cfile_cache_miss_bytes":18566868,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":1118,"dirs.run_cpu_time_us":899,"dirs.run_wall_time_us":3468,"drs_written":1,"lbm_read_time_us":10477,"lbm_reads_lt_1ms":347,"lbm_write_time_us":14878,"lbm_writes_lt_1ms":335,"num_input_rowsets":2,"peak_mem_usage":4251694,"rows_written":266700,"spinlock_wait_cycles":2432}
I20260615 08:09:18.352169 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:18.374624 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.049s user 0.031s sys 0.003s Metrics: {"bytes_written":815850,"cfile_init":1,"dirs.queue_time_us":597,"dirs.run_cpu_time_us":89,"dirs.run_wall_time_us":2506,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2372,"lbm_writes_lt_1ms":54,"peak_mem_usage":0,"rows_written":28700}
I20260615 08:09:18.374872 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1074666 bytes of WAL
I20260615 08:09:18.375002 15667 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:18.375070 15667 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P a4dd9f5055864b28a3998e289ddb3760: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000009 (ops 4931-5548)
I20260615 08:09:18.375491 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:18.375643 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 3066390 bytes on disk
I20260615 08:09:18.375847 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":40,"lbm_reads_lt_1ms":8}
I20260615 08:09:18.376029 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.012023
I20260615 08:09:18.379410 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.027s user 0.014s sys 0.004s Metrics: {"bytes_written":390120,"cfile_init":1,"dirs.queue_time_us":23,"dirs.run_cpu_time_us":78,"dirs.run_wall_time_us":390,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":840,"lbm_writes_lt_1ms":36,"peak_mem_usage":0,"rows_written":13600}
I20260615 08:09:18.379621 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 3091608 bytes on disk
I20260615 08:09:18.379848 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":30,"lbm_reads_lt_1ms":8}
I20260615 08:09:18.380000 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.011985
I20260615 08:09:18.503938 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.502s user 0.291s sys 0.038s Metrics: {"bytes_written":7418813,"cfile_cache_hit":12,"cfile_cache_hit_bytes":772250,"cfile_cache_miss":328,"cfile_cache_miss_bytes":18627812,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":42,"dirs.run_cpu_time_us":102,"dirs.run_wall_time_us":573,"drs_written":1,"lbm_read_time_us":14248,"lbm_reads_lt_1ms":348,"lbm_write_time_us":21059,"lbm_writes_lt_1ms":334,"num_input_rowsets":2,"peak_mem_usage":4230973,"rows_written":265650,"spinlock_wait_cycles":3072,"thread_start_us":217,"threads_started":5}
I20260615 08:09:18.504259 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:18.538694 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.034s user 0.024s sys 0.001s Metrics: {"bytes_written":522329,"cfile_init":1,"dirs.queue_time_us":22,"dirs.run_cpu_time_us":102,"dirs.run_wall_time_us":635,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2539,"lbm_writes_lt_1ms":42,"peak_mem_usage":0,"rows_written":18350}
I20260615 08:09:18.538956 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 3126557 bytes on disk
I20260615 08:09:18.539678 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":34,"lbm_reads_lt_1ms":8}
I20260615 08:09:18.539841 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.011984
I20260615 08:09:18.720227 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.344s user 0.297s sys 0.023s Metrics: {"bytes_written":7805291,"cfile_cache_hit":11,"cfile_cache_hit_bytes":693296,"cfile_cache_miss":347,"cfile_cache_miss_bytes":19735386,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":570,"dirs.run_cpu_time_us":111,"dirs.run_wall_time_us":648,"drs_written":1,"lbm_read_time_us":7837,"lbm_reads_lt_1ms":367,"lbm_write_time_us":14331,"lbm_writes_lt_1ms":350,"num_input_rowsets":2,"peak_mem_usage":4450552,"rows_written":279650,"spinlock_wait_cycles":2048}
I20260615 08:09:18.720511 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:18.738762 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.018s user 0.013s sys 0.001s Metrics: {"bytes_written":276266,"cfile_init":1,"dirs.queue_time_us":26,"dirs.run_cpu_time_us":91,"dirs.run_wall_time_us":419,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":660,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9600}
I20260615 08:09:18.739059 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 3202117 bytes on disk
I20260615 08:09:18.739275 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":30,"lbm_reads_lt_1ms":8}
I20260615 08:09:18.739457 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.011826
I20260615 08:09:18.741472 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.361s user 0.307s sys 0.021s Metrics: {"bytes_written":7821721,"cfile_cache_hit":11,"cfile_cache_hit_bytes":564974,"cfile_cache_miss":351,"cfile_cache_miss_bytes":19932576,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":37,"dirs.run_cpu_time_us":110,"dirs.run_wall_time_us":608,"drs_written":1,"lbm_read_time_us":8459,"lbm_reads_lt_1ms":371,"lbm_write_time_us":14114,"lbm_writes_lt_1ms":350,"num_input_rowsets":2,"peak_mem_usage":4477878,"rows_written":280300,"spinlock_wait_cycles":896}
I20260615 08:09:18.743767 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 3121395 bytes on disk
I20260615 08:09:18.743961 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":22,"lbm_reads_lt_1ms":4,"spinlock_wait_cycles":4864}
I20260615 08:09:18.744124 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:18.761495 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.017s user 0.013s sys 0.000s Metrics: {"bytes_written":274953,"cfile_init":1,"dirs.queue_time_us":21,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":824,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"rows_written":9550}
I20260615 08:09:18.762017 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1099540 bytes of WAL
I20260615 08:09:18.762562 15742 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:18.762643 15742 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 4d643312c2624f1f9426f230a68981b0: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000009 (ops 5045-5706)
I20260615 08:09:18.763129 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:18.763270 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.011820
I20260615 08:09:19.077018 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.537s user 0.313s sys 0.034s Metrics: {"bytes_written":7927987,"cfile_cache_hit":11,"cfile_cache_hit_bytes":582802,"cfile_cache_miss":355,"cfile_cache_miss_bytes":20175172,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":137,"dirs.run_wall_time_us":572,"drs_written":1,"lbm_read_time_us":19464,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":373,"lbm_write_time_us":23820,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":354,"num_input_rowsets":2,"peak_mem_usage":4529945,"rows_written":284000,"spinlock_wait_cycles":384}
I20260615 08:09:19.077555 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:19.134506 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.056s user 0.025s sys 0.000s Metrics: {"bytes_written":499655,"cfile_init":1,"dirs.queue_time_us":21,"dirs.run_cpu_time_us":258,"dirs.run_wall_time_us":1311,"drs_written":1,"lbm_read_time_us":23,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1695,"lbm_writes_lt_1ms":42,"peak_mem_usage":0,"rows_written":17450}
I20260615 08:09:19.134795 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 3330802 bytes on disk
I20260615 08:09:19.135003 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":40,"lbm_reads_lt_1ms":8}
I20260615 08:09:19.136878 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1104394 bytes of WAL
I20260615 08:09:19.137305 15591 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:19.137383 15591 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000010 (ops 5279-5886)
I20260615 08:09:19.138172 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:19.138305 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.011657
I20260615 08:09:19.151721 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.412s user 0.321s sys 0.017s Metrics: {"bytes_written":8075196,"cfile_cache_hit":12,"cfile_cache_hit_bytes":641187,"cfile_cache_miss":360,"cfile_cache_miss_bytes":20524017,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":222,"dirs.run_cpu_time_us":191,"dirs.run_wall_time_us":1148,"drs_written":1,"lbm_read_time_us":13399,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":379,"lbm_write_time_us":18633,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":360,"num_input_rowsets":2,"peak_mem_usage":4625661,"rows_written":289250,"spinlock_wait_cycles":3840}
I20260615 08:09:19.151959 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:19.177457 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.025s user 0.020s sys 0.001s Metrics: {"bytes_written":427338,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":80,"dirs.run_wall_time_us":398,"drs_written":1,"lbm_read_time_us":12,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1492,"lbm_writes_lt_1ms":38,"peak_mem_usage":0,"rows_written":14900}
I20260615 08:09:19.177724 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.011626
I20260615 08:09:19.272012 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.509s user 0.318s sys 0.021s Metrics: {"bytes_written":8090588,"cfile_cache_hit":13,"cfile_cache_hit_bytes":805366,"cfile_cache_miss":359,"cfile_cache_miss_bytes":20404136,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":61,"dirs.run_cpu_time_us":98,"dirs.run_wall_time_us":512,"drs_written":1,"lbm_read_time_us":14067,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":381,"lbm_write_time_us":25718,"lbm_writes_1-10_ms":4,"lbm_writes_lt_1ms":357,"num_input_rowsets":2,"peak_mem_usage":4635461,"rows_written":289850,"spinlock_wait_cycles":7941120,"thread_start_us":1684,"threads_started":5}
I20260615 08:09:19.272328 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 3231509 bytes on disk
I20260615 08:09:19.273510 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20260615 08:09:19.273701 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:19.312979 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.039s user 0.019s sys 0.004s Metrics: {"bytes_written":521240,"cfile_init":1,"dirs.queue_time_us":23,"dirs.run_cpu_time_us":77,"dirs.run_wall_time_us":834,"drs_written":1,"lbm_read_time_us":104,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1073,"lbm_writes_lt_1ms":42,"peak_mem_usage":0,"rows_written":18300}
I20260615 08:09:19.313257 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 176075 bytes on disk
I20260615 08:09:19.314177 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":25,"lbm_reads_lt_1ms":4}
I20260615 08:09:19.314399 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.011588
I20260615 08:09:19.594844 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.456s user 0.331s sys 0.027s Metrics: {"bytes_written":8412228,"cfile_cache_hit":11,"cfile_cache_hit_bytes":692834,"cfile_cache_miss":375,"cfile_cache_miss_bytes":21356000,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":52,"dirs.run_cpu_time_us":113,"dirs.run_wall_time_us":735,"drs_written":1,"lbm_read_time_us":14124,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":393,"lbm_write_time_us":20899,"lbm_writes_lt_1ms":375,"num_input_rowsets":2,"peak_mem_usage":4816036,"rows_written":301450,"spinlock_wait_cycles":1792}
I20260615 08:09:19.595178 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:19.629671 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.034s user 0.023s sys 0.000s Metrics: {"bytes_written":494517,"cfile_init":1,"dirs.queue_time_us":20,"dirs.run_cpu_time_us":90,"dirs.run_wall_time_us":462,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2731,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":40,"peak_mem_usage":0,"rows_written":17250}
I20260615 08:09:19.629949 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 3527762 bytes on disk
I20260615 08:09:19.630211 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":41,"lbm_reads_lt_1ms":8}
I20260615 08:09:19.630748 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.011292
I20260615 08:09:19.633836 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.456s user 0.344s sys 0.012s Metrics: {"bytes_written":8485855,"cfile_cache_hit":11,"cfile_cache_hit_bytes":573520,"cfile_cache_miss":377,"cfile_cache_miss_bytes":21689150,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":133,"dirs.run_cpu_time_us":106,"dirs.run_wall_time_us":592,"drs_written":1,"lbm_read_time_us":12856,"lbm_reads_lt_1ms":405,"lbm_write_time_us":18827,"lbm_writes_lt_1ms":377,"num_input_rowsets":2,"peak_mem_usage":4862467,"rows_written":304150,"spinlock_wait_cycles":1152,"thread_start_us":102,"threads_started":1}
I20260615 08:09:19.634085 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 3396901 bytes on disk
I20260615 08:09:19.634209 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20260615 08:09:19.634306 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:19.662604 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.028s user 0.017s sys 0.004s Metrics: {"bytes_written":456413,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":90,"dirs.run_wall_time_us":1481,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1437,"lbm_writes_lt_1ms":40,"peak_mem_usage":0,"rows_written":15900}
I20260615 08:09:19.664913 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1060415 bytes of WAL
I20260615 08:09:19.665055 15667 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:19.665117 15667 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P a4dd9f5055864b28a3998e289ddb3760: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000010 (ops 5549-6152)
I20260615 08:09:19.665545 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:19.665675 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 149699 bytes on disk
I20260615 08:09:19.665850 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":21,"lbm_reads_lt_1ms":4}
I20260615 08:09:19.665978 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.011252
I20260615 08:09:19.847628 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.532s user 0.331s sys 0.031s Metrics: {"bytes_written":8596280,"cfile_cache_hit":13,"cfile_cache_hit_bytes":911992,"cfile_cache_miss":379,"cfile_cache_miss_bytes":21634038,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":1636,"dirs.run_cpu_time_us":127,"dirs.run_wall_time_us":686,"drs_written":1,"lbm_read_time_us":13959,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":397,"lbm_write_time_us":20194,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":381,"num_input_rowsets":2,"peak_mem_usage":4924058,"rows_written":308150,"spinlock_wait_cycles":6602624,"thread_start_us":210,"threads_started":5}
I20260615 08:09:19.847942 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.937278
I20260615 08:09:19.884856 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.037s user 0.019s sys 0.008s Metrics: {"bytes_written":574974,"cfile_init":1,"dirs.queue_time_us":28,"dirs.run_cpu_time_us":81,"dirs.run_wall_time_us":471,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1638,"lbm_writes_lt_1ms":44,"peak_mem_usage":0,"rows_written":20200}
I20260615 08:09:19.885169 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1064505 bytes of WAL
I20260615 08:09:19.885349 15742 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:19.885438 15742 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 4d643312c2624f1f9426f230a68981b0: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000010 (ops 5707-6346)
I20260615 08:09:19.885950 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:19.886226 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.011459
I20260615 08:09:20.164610 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.534s user 0.357s sys 0.018s Metrics: {"bytes_written":8890543,"cfile_cache_hit":16,"cfile_cache_hit_bytes":1269477,"cfile_cache_miss":388,"cfile_cache_miss_bytes":22049089,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":3857,"dirs.run_cpu_time_us":625,"dirs.run_wall_time_us":4754,"drs_written":1,"lbm_read_time_us":14326,"lbm_reads_lt_1ms":408,"lbm_write_time_us":24988,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":393,"num_input_rowsets":2,"peak_mem_usage":5094884,"rows_written":318700,"spinlock_wait_cycles":768,"thread_start_us":4478,"threads_started":4}
I20260615 08:09:20.164934 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 3564866 bytes on disk
I20260615 08:09:20.165082 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20260615 08:09:20.165336 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.937278
I20260615 08:09:20.203445 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.038s user 0.024s sys 0.000s Metrics: {"bytes_written":546463,"cfile_init":1,"dirs.queue_time_us":18,"dirs.run_cpu_time_us":105,"dirs.run_wall_time_us":470,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1865,"lbm_writes_lt_1ms":43,"peak_mem_usage":0,"rows_written":19100}
I20260615 08:09:20.204454 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1060698 bytes of WAL
I20260615 08:09:20.204648 15591 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:20.204723 15591 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000011 (ops 5887-6470)
I20260615 08:09:20.205334 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:20.205495 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 182856 bytes on disk
I20260615 08:09:20.205927 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:09:20.206681 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.011358
I20260615 08:09:20.289191 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.623s user 0.350s sys 0.047s Metrics: {"bytes_written":8927160,"cfile_cache_hit":15,"cfile_cache_hit_bytes":1173951,"cfile_cache_miss":391,"cfile_cache_miss_bytes":22253379,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":81351,"dirs.run_cpu_time_us":191,"dirs.run_wall_time_us":705,"drs_written":1,"lbm_read_time_us":16209,"lbm_reads_lt_1ms":411,"lbm_write_time_us":28521,"lbm_writes_1-10_ms":3,"lbm_writes_lt_1ms":394,"num_input_rowsets":2,"peak_mem_usage":5118168,"rows_written":320050,"spinlock_wait_cycles":768,"thread_start_us":268,"threads_started":6}
I20260615 08:09:20.289498 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.937278
I20260615 08:09:20.304126 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.418s user 0.355s sys 0.025s Metrics: {"bytes_written":9158972,"cfile_cache_hit":14,"cfile_cache_hit_bytes":1080593,"cfile_cache_miss":402,"cfile_cache_miss_bytes":22941441,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":357,"dirs.run_cpu_time_us":115,"dirs.run_wall_time_us":596,"drs_written":1,"lbm_read_time_us":12375,"lbm_reads_lt_1ms":430,"lbm_write_time_us":16635,"lbm_writes_lt_1ms":408,"num_input_rowsets":2,"peak_mem_usage":5250382,"rows_written":328350,"spinlock_wait_cycles":896}
I20260615 08:09:20.304790 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 3675909 bytes on disk
I20260615 08:09:20.305058 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20260615 08:09:20.305245 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:20.339581 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.050s user 0.028s sys 0.000s Metrics: {"bytes_written":609131,"cfile_init":1,"dirs.queue_time_us":876,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2536,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":44,"peak_mem_usage":0,"rows_written":21350}
I20260615 08:09:20.340092 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1059665 bytes of WAL
I20260615 08:09:20.340246 15667 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:20.340323 15667 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P a4dd9f5055864b28a3998e289ddb3760: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000011 (ops 6153-6757)
I20260615 08:09:20.340829 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:20.341135 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 3787387 bytes on disk
I20260615 08:09:20.341311 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":36,"lbm_reads_lt_1ms":8}
I20260615 08:09:20.342103 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.011347
I20260615 08:09:20.345041 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.040s user 0.016s sys 0.004s Metrics: {"bytes_written":391402,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":92,"dirs.run_wall_time_us":16259,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1166,"lbm_writes_lt_1ms":36,"peak_mem_usage":0,"rows_written":13650}
I20260615 08:09:20.345229 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.011318
I20260615 08:09:20.864253 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.518s user 0.357s sys 0.035s Metrics: {"bytes_written":9532761,"cfile_cache_hit":17,"cfile_cache_hit_bytes":1546592,"cfile_cache_miss":417,"cfile_cache_miss_bytes":23508428,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":29,"dirs.run_cpu_time_us":111,"dirs.run_wall_time_us":594,"drs_written":1,"lbm_read_time_us":11497,"lbm_reads_lt_1ms":441,"lbm_write_time_us":23386,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":421,"num_input_rowsets":2,"peak_mem_usage":5477083,"rows_written":342000,"spinlock_wait_cycles":3072}
I20260615 08:09:20.864475 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 3833286 bytes on disk
I20260615 08:09:20.864629 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20260615 08:09:20.864756 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.937278
I20260615 08:09:20.906024 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.563s user 0.354s sys 0.041s Metrics: {"bytes_written":9516366,"cfile_cache_hit":15,"cfile_cache_hit_bytes":1207815,"cfile_cache_miss":415,"cfile_cache_miss_bytes":23782001,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":45,"dirs.run_cpu_time_us":110,"dirs.run_wall_time_us":591,"drs_written":1,"lbm_read_time_us":15336,"lbm_reads_lt_1ms":435,"lbm_write_time_us":23234,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":422,"num_input_rowsets":2,"peak_mem_usage":5459631,"rows_written":341400,"spinlock_wait_cycles":3328,"thread_start_us":275,"threads_started":5}
I20260615 08:09:20.907209 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 3826600 bytes on disk
I20260615 08:09:20.907437 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:09:20.907788 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.937278
I20260615 08:09:20.921839 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.057s user 0.027s sys 0.000s Metrics: {"bytes_written":609053,"cfile_init":1,"dirs.queue_time_us":17,"dirs.run_cpu_time_us":118,"dirs.run_wall_time_us":5190,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":5070,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":44,"peak_mem_usage":0,"rows_written":21350}
I20260615 08:09:20.922881 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1052279 bytes of WAL
I20260615 08:09:20.923040 15742 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:20.923118 15742 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 4d643312c2624f1f9426f230a68981b0: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000011 (ops 6347-6994)
I20260615 08:09:20.923563 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:20.923705 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.011141
I20260615 08:09:20.957923 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.050s user 0.031s sys 0.000s Metrics: {"bytes_written":667862,"cfile_init":1,"dirs.queue_time_us":30,"dirs.run_cpu_time_us":119,"dirs.run_wall_time_us":501,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2695,"lbm_writes_lt_1ms":47,"peak_mem_usage":0,"rows_written":23450}
I20260615 08:09:20.958611 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 224637 bytes on disk
I20260615 08:09:20.958838 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4}
I20260615 08:09:20.959146 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.011126
I20260615 08:09:21.099916 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.893s user 0.366s sys 0.045s Metrics: {"bytes_written":9416829,"cfile_cache_hit":17,"cfile_cache_hit_bytes":1522221,"cfile_cache_miss":409,"cfile_cache_miss_bytes":23206173,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":8912,"dirs.run_cpu_time_us":118,"dirs.run_wall_time_us":1292,"drs_written":1,"lbm_read_time_us":27359,"lbm_reads_1-10_ms":3,"lbm_reads_lt_1ms":426,"lbm_write_time_us":45173,"lbm_writes_1-10_ms":7,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":411,"num_input_rowsets":2,"peak_mem_usage":5406689,"rows_written":337800,"spinlock_wait_cycles":4480,"thread_start_us":329,"threads_started":6}
I20260615 08:09:21.100304 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 3784890 bytes on disk
I20260615 08:09:21.102672 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:09:21.103190 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=2.929465
I20260615 08:09:21.165763 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.062s user 0.034s sys 0.007s Metrics: {"bytes_written":966933,"cfile_init":1,"dirs.queue_time_us":26,"dirs.run_cpu_time_us":117,"dirs.run_wall_time_us":520,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1858,"lbm_writes_lt_1ms":59,"peak_mem_usage":0,"rows_written":34150}
I20260615 08:09:21.166076 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1071565 bytes of WAL
I20260615 08:09:21.166219 15591 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:21.166283 15591 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000012 (ops 6471-7060)
I20260615 08:09:21.166759 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:21.166890 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 333007 bytes on disk
I20260615 08:09:21.167550 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":25,"lbm_reads_lt_1ms":4}
I20260615 08:09:21.167719 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.011056
I20260615 08:09:21.391006 4267 test_workload.cc:405] TestWorkload: Skipping table creation because table test-workload already exists
I20260615 08:09:21.471329 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.512s user 0.393s sys 0.028s Metrics: {"bytes_written":10164885,"cfile_cache_hit":14,"cfile_cache_hit_bytes":1085602,"cfile_cache_miss":446,"cfile_cache_miss_bytes":25620666,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":79,"dirs.run_cpu_time_us":132,"dirs.run_wall_time_us":699,"drs_written":1,"lbm_read_time_us":13475,"lbm_reads_lt_1ms":466,"lbm_write_time_us":23358,"lbm_writes_lt_1ms":450,"num_input_rowsets":2,"peak_mem_usage":5840213,"rows_written":364850,"spinlock_wait_cycles":4352,"thread_start_us":209,"threads_started":5}
I20260615 08:09:21.471715 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.937278
I20260615 08:09:21.507607 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.036s user 0.017s sys 0.010s Metrics: {"bytes_written":605309,"cfile_init":1,"dirs.queue_time_us":139,"dirs.run_cpu_time_us":82,"dirs.run_wall_time_us":440,"drs_written":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2078,"lbm_writes_lt_1ms":45,"peak_mem_usage":0,"rows_written":21200}
I20260615 08:09:21.508520 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1052052 bytes of WAL
I20260615 08:09:21.508692 15667 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:21.508770 15667 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P a4dd9f5055864b28a3998e289ddb3760: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000012 (ops 6758-7381)
I20260615 08:09:21.509183 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:21.509872 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 4302223 bytes on disk
I20260615 08:09:21.510098 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":46,"lbm_reads_lt_1ms":8}
I20260615 08:09:21.510251 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.010939
I20260615 08:09:21.743166 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.819s user 0.405s sys 0.030s Metrics: {"bytes_written":10123070,"cfile_cache_hit":15,"cfile_cache_hit_bytes":1144526,"cfile_cache_miss":443,"cfile_cache_miss_bytes":25456636,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":10285,"dirs.run_cpu_time_us":110,"dirs.run_wall_time_us":1104,"drs_written":1,"lbm_read_time_us":15619,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":466,"lbm_write_time_us":31299,"lbm_writes_1-10_ms":6,"lbm_writes_lt_1ms":442,"num_input_rowsets":2,"peak_mem_usage":5817945,"rows_written":363350,"spinlock_wait_cycles":768,"thread_start_us":482,"threads_started":6}
I20260615 08:09:21.743541 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 4079669 bytes on disk
I20260615 08:09:21.743782 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:09:21.743984 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=2.929465
I20260615 08:09:21.802691 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.059s user 0.035s sys 0.005s Metrics: {"bytes_written":938212,"cfile_init":1,"dirs.queue_time_us":24,"dirs.run_cpu_time_us":127,"dirs.run_wall_time_us":479,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3225,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":58,"peak_mem_usage":0,"rows_written":33050}
I20260615 08:09:21.803077 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1048187 bytes of WAL
I20260615 08:09:21.803256 15742 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:21.803326 15742 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 4d643312c2624f1f9426f230a68981b0: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000012 (ops 6995-7638)
I20260615 08:09:21.803853 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:21.804029 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.010833
I20260615 08:09:21.847955 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.680s user 0.399s sys 0.047s Metrics: {"bytes_written":10363624,"cfile_cache_hit":15,"cfile_cache_hit_bytes":1279731,"cfile_cache_miss":453,"cfile_cache_miss_bytes":25925995,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":2694,"dirs.run_cpu_time_us":100,"dirs.run_wall_time_us":15404,"drs_written":1,"lbm_read_time_us":18416,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":471,"lbm_write_time_us":31930,"lbm_writes_1-10_ms":3,"lbm_writes_lt_1ms":455,"num_input_rowsets":2,"peak_mem_usage":5944870,"rows_written":371950,"spinlock_wait_cycles":3584,"thread_start_us":369,"threads_started":6}
I20260615 08:09:21.848289 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 4178673 bytes on disk
I20260615 08:09:21.848453 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4}
I20260615 08:09:21.848641 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=2.929465
I20260615 08:09:21.907971 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.059s user 0.045s sys 0.000s Metrics: {"bytes_written":957634,"cfile_init":1,"dirs.queue_time_us":23,"dirs.run_cpu_time_us":113,"dirs.run_wall_time_us":502,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2357,"lbm_writes_lt_1ms":59,"peak_mem_usage":0,"rows_written":33800}
I20260615 08:09:21.908237 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1049893 bytes of WAL
I20260615 08:09:21.908552 15591 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:21.908638 15591 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000013 (ops 7061-7638)
I20260615 08:09:21.909106 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:21.909252 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 329146 bytes on disk
I20260615 08:09:21.909503 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":23,"lbm_reads_lt_1ms":4}
I20260615 08:09:21.909700 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.010736
I20260615 08:09:22.435285 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.631s user 0.425s sys 0.038s Metrics: {"bytes_written":11036101,"cfile_cache_hit":18,"cfile_cache_hit_bytes":1610238,"cfile_cache_miss":478,"cfile_cache_miss_bytes":27404110,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":10791,"dirs.run_cpu_time_us":112,"dirs.run_wall_time_us":931,"drs_written":1,"lbm_read_time_us":20364,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":500,"lbm_write_time_us":29311,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":486,"num_input_rowsets":2,"peak_mem_usage":6341608,"rows_written":396400,"spinlock_wait_cycles":2048,"thread_start_us":260,"threads_started":6}
I20260615 08:09:22.435591 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 4462500 bytes on disk
I20260615 08:09:22.435763 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:09:22.435886 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=2.929465
I20260615 08:09:22.478434 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.042s user 0.037s sys 0.000s Metrics: {"bytes_written":863884,"cfile_init":1,"dirs.queue_time_us":22,"dirs.run_cpu_time_us":88,"dirs.run_wall_time_us":453,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2543,"lbm_writes_lt_1ms":56,"peak_mem_usage":0,"rows_written":30450}
I20260615 08:09:22.478744 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1079523 bytes of WAL
I20260615 08:09:22.478873 15742 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:22.478938 15742 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 4d643312c2624f1f9426f230a68981b0: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000013 (ops 7639-8287)
I20260615 08:09:22.479357 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:22.479482 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 299061 bytes on disk
I20260615 08:09:22.479624 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4}
I20260615 08:09:22.479780 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.010478
I20260615 08:09:22.563659 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.654s user 0.426s sys 0.054s Metrics: {"bytes_written":11296065,"cfile_cache_hit":15,"cfile_cache_hit_bytes":1169132,"cfile_cache_miss":491,"cfile_cache_miss_bytes":28526654,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":9971,"dirs.run_cpu_time_us":100,"dirs.run_wall_time_us":1262,"drs_written":1,"lbm_read_time_us":17669,"lbm_reads_lt_1ms":511,"lbm_write_time_us":32752,"lbm_writes_1-10_ms":3,"lbm_writes_lt_1ms":497,"num_input_rowsets":2,"peak_mem_usage":6494433,"rows_written":405750,"spinlock_wait_cycles":30868480,"thread_start_us":382,"threads_started":6}
I20260615 08:09:22.563865 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 4569224 bytes on disk
I20260615 08:09:22.564287 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4}
I20260615 08:09:22.564435 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.937278
I20260615 08:09:22.589383 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 1.079s user 0.432s sys 0.037s Metrics: {"bytes_written":10751293,"cfile_cache_hit":18,"cfile_cache_hit_bytes":1724409,"cfile_cache_miss":466,"cfile_cache_miss_bytes":26548697,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":17020,"dirs.run_cpu_time_us":128,"dirs.run_wall_time_us":618,"drs_written":1,"lbm_read_time_us":21946,"lbm_reads_1-10_ms":4,"lbm_reads_lt_1ms":482,"lbm_write_time_us":36201,"lbm_writes_1-10_ms":3,"lbm_writes_lt_1ms":471,"num_input_rowsets":2,"peak_mem_usage":6186944,"rows_written":386050,"spinlock_wait_cycles":36183680,"thread_start_us":304,"threads_started":6}
I20260615 08:09:22.589671 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 4342878 bytes on disk
I20260615 08:09:22.590095 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:09:22.590248 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=3.921653
I20260615 08:09:22.625450 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.061s user 0.033s sys 0.004s Metrics: {"bytes_written":677069,"cfile_init":1,"dirs.queue_time_us":23,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3503,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":46,"peak_mem_usage":0,"rows_written":23800}
I20260615 08:09:22.627341 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1063885 bytes of WAL
I20260615 08:09:22.627421 15591 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:22.627463 15591 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000014 (ops 7639-8224)
I20260615 08:09:22.627904 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:22.628033 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 231415 bytes on disk
I20260615 08:09:22.628185 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":21,"lbm_reads_lt_1ms":4}
I20260615 08:09:22.628314 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.010468
I20260615 08:09:22.647153 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.057s user 0.048s sys 0.000s Metrics: {"bytes_written":1251221,"cfile_init":1,"dirs.queue_time_us":25,"dirs.run_cpu_time_us":85,"dirs.run_wall_time_us":554,"drs_written":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4,"lbm_write_time_us":4476,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":70,"peak_mem_usage":0,"rows_written":44250}
I20260615 08:09:22.647400 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1054511 bytes of WAL
I20260615 08:09:22.647571 15667 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:22.647646 15667 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P a4dd9f5055864b28a3998e289ddb3760: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000013 (ops 7382-8011)
I20260615 08:09:22.648358 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:22.648501 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.010466
I20260615 08:09:23.142442 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.494s user 0.457s sys 0.028s Metrics: {"bytes_written":11974678,"cfile_cache_hit":11,"cfile_cache_hit_bytes":655794,"cfile_cache_miss":523,"cfile_cache_miss_bytes":30843272,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":53,"dirs.run_cpu_time_us":115,"dirs.run_wall_time_us":538,"drs_written":1,"lbm_read_time_us":13405,"lbm_reads_lt_1ms":547,"lbm_write_time_us":21868,"lbm_writes_lt_1ms":528,"num_input_rowsets":2,"peak_mem_usage":6881231,"rows_written":430300,"spinlock_wait_cycles":2048,"thread_start_us":190,"threads_started":5}
I20260615 08:09:23.142768 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 4850935 bytes on disk
I20260615 08:09:23.142956 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":50,"lbm_reads_lt_1ms":4}
I20260615 08:09:23.143153 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:23.166729 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.023s user 0.014s sys 0.004s Metrics: {"bytes_written":361339,"cfile_init":1,"dirs.queue_time_us":31,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":861,"lbm_writes_lt_1ms":35,"peak_mem_usage":0,"rows_written":12500}
I20260615 08:09:23.167131 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1090736 bytes of WAL
I20260615 08:09:23.167302 15667 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:23.167469 15667 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P a4dd9f5055864b28a3998e289ddb3760: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000014 (ops 8012-8650)
I20260615 08:09:23.169664 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.002s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:23.169844 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.010283
I20260615 08:09:23.188652 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.560s user 0.481s sys 0.052s Metrics: {"bytes_written":11955852,"cfile_cache_hit":12,"cfile_cache_hit_bytes":760650,"cfile_cache_miss":526,"cfile_cache_miss_bytes":30709176,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":580,"dirs.run_cpu_time_us":114,"dirs.run_wall_time_us":567,"drs_written":1,"lbm_read_time_us":15586,"lbm_reads_lt_1ms":546,"lbm_write_time_us":24653,"lbm_writes_lt_1ms":527,"num_input_rowsets":2,"peak_mem_usage":6894468,"rows_written":429550,"spinlock_wait_cycles":768,"thread_start_us":257,"threads_started":5}
I20260615 08:09:23.188868 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 4842730 bytes on disk
I20260615 08:09:23.189030 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20260615 08:09:23.189160 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:23.219099 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.030s user 0.015s sys 0.006s Metrics: {"bytes_written":409632,"cfile_init":1,"dirs.queue_time_us":1499,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1072,"lbm_writes_lt_1ms":38,"peak_mem_usage":0,"rows_written":14200}
I20260615 08:09:23.220263 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1100667 bytes of WAL
I20260615 08:09:23.220408 15591 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:23.220474 15591 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000015 (ops 8225-8830)
I20260615 08:09:23.221679 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:23.222023 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 132851 bytes on disk
I20260615 08:09:23.222149 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":22,"lbm_reads_lt_1ms":4}
I20260615 08:09:23.222550 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.010273
I20260615 08:09:23.275056 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.795s user 0.450s sys 0.044s Metrics: {"bytes_written":11879991,"cfile_cache_hit":14,"cfile_cache_hit_bytes":1099965,"cfile_cache_miss":522,"cfile_cache_miss_bytes":30161879,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":19781,"dirs.run_cpu_time_us":103,"dirs.run_wall_time_us":1869,"drs_written":1,"lbm_read_time_us":28004,"lbm_reads_1-10_ms":4,"lbm_reads_lt_1ms":538,"lbm_write_time_us":32635,"lbm_writes_1-10_ms":3,"lbm_writes_lt_1ms":520,"num_input_rowsets":2,"peak_mem_usage":6840633,"rows_written":426850,"spinlock_wait_cycles":7415808,"thread_start_us":976,"threads_started":6}
I20260615 08:09:23.275368 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.937278
I20260615 08:09:23.333369 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.058s user 0.022s sys 0.003s Metrics: {"bytes_written":561902,"cfile_init":1,"dirs.queue_time_us":23,"dirs.run_cpu_time_us":95,"dirs.run_wall_time_us":495,"drs_written":1,"lbm_read_time_us":13,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1694,"lbm_writes_lt_1ms":44,"peak_mem_usage":0,"rows_written":19700}
I20260615 08:09:23.333660 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1059892 bytes of WAL
I20260615 08:09:23.334012 15742 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:23.334112 15742 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 4d643312c2624f1f9426f230a68981b0: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000014 (ops 8288-8887)
I20260615 08:09:23.334592 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:23.334731 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 5000213 bytes on disk
I20260615 08:09:23.334959 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":35,"lbm_reads_lt_1ms":8}
I20260615 08:09:23.335108 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.010247
I20260615 08:09:23.693363 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.523s user 0.473s sys 0.027s Metrics: {"bytes_written":12320069,"cfile_cache_hit":11,"cfile_cache_hit_bytes":542677,"cfile_cache_miss":543,"cfile_cache_miss_bytes":31919865,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":51,"dirs.run_cpu_time_us":157,"dirs.run_wall_time_us":651,"drs_written":1,"lbm_read_time_us":13830,"lbm_reads_lt_1ms":567,"lbm_write_time_us":27279,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":541,"num_input_rowsets":2,"peak_mem_usage":7122724,"rows_written":442800,"spinlock_wait_cycles":4259456,"thread_start_us":195,"threads_started":5}
I20260615 08:09:23.693719 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:23.719638 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.026s user 0.015s sys 0.003s Metrics: {"bytes_written":362561,"cfile_init":1,"dirs.queue_time_us":23,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":967,"lbm_writes_lt_1ms":35,"peak_mem_usage":0,"rows_written":12550}
I20260615 08:09:23.719924 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 5113302 bytes on disk
I20260615 08:09:23.720227 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":34,"lbm_reads_lt_1ms":8}
I20260615 08:09:23.720463 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.010124
I20260615 08:09:23.797032 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.571s user 0.491s sys 0.047s Metrics: {"bytes_written":12347606,"cfile_cache_hit":13,"cfile_cache_hit_bytes":892025,"cfile_cache_miss":543,"cfile_cache_miss_bytes":31638231,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":61,"dirs.run_cpu_time_us":121,"dirs.run_wall_time_us":672,"drs_written":1,"lbm_read_time_us":15070,"lbm_reads_lt_1ms":563,"lbm_write_time_us":26765,"lbm_writes_lt_1ms":543,"num_input_rowsets":2,"peak_mem_usage":7134813,"rows_written":443750,"spinlock_wait_cycles":384,"thread_start_us":235,"threads_started":5}
I20260615 08:09:23.797214 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:23.826733 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.029s user 0.020s sys 0.004s Metrics: {"bytes_written":397085,"cfile_init":1,"dirs.queue_time_us":19,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1793,"lbm_writes_lt_1ms":37,"peak_mem_usage":0,"rows_written":13700}
I20260615 08:09:23.826923 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 5135604 bytes on disk
I20260615 08:09:23.827291 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":31,"lbm_reads_lt_1ms":8}
I20260615 08:09:23.827499 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.010101
I20260615 08:09:24.071328 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.736s user 0.485s sys 0.030s Metrics: {"bytes_written":12423941,"cfile_cache_hit":17,"cfile_cache_hit_bytes":1547357,"cfile_cache_miss":541,"cfile_cache_miss_bytes":31176753,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":21707,"dirs.run_cpu_time_us":112,"dirs.run_wall_time_us":638,"drs_written":1,"lbm_read_time_us":18134,"lbm_reads_lt_1ms":561,"lbm_write_time_us":31529,"lbm_writes_lt_1ms":547,"num_input_rowsets":2,"peak_mem_usage":7174798,"rows_written":446550,"spinlock_wait_cycles":1664,"thread_start_us":453,"threads_started":6}
I20260615 08:09:24.071569 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:24.119071 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.047s user 0.023s sys 0.001s Metrics: {"bytes_written":539909,"cfile_init":1,"dirs.queue_time_us":16,"dirs.run_cpu_time_us":87,"dirs.run_wall_time_us":445,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2579,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":42,"peak_mem_usage":0,"rows_written":18850}
I20260615 08:09:24.119310 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 5218813 bytes on disk
I20260615 08:09:24.119474 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":40,"lbm_reads_lt_1ms":8}
I20260615 08:09:24.119628 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.010021
I20260615 08:09:24.297753 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.577s user 0.497s sys 0.029s Metrics: {"bytes_written":12668926,"cfile_cache_hit":13,"cfile_cache_hit_bytes":862268,"cfile_cache_miss":555,"cfile_cache_miss_bytes":32528302,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":50,"dirs.run_cpu_time_us":148,"dirs.run_wall_time_us":515,"drs_written":1,"lbm_read_time_us":15924,"lbm_reads_lt_1ms":575,"lbm_write_time_us":23972,"lbm_writes_lt_1ms":556,"num_input_rowsets":2,"peak_mem_usage":7324948,"rows_written":455350,"spinlock_wait_cycles":288512,"thread_start_us":242,"threads_started":5}
I20260615 08:09:24.298751 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:24.325479 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.027s user 0.021s sys 0.001s Metrics: {"bytes_written":451365,"cfile_init":1,"dirs.queue_time_us":19,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1150,"lbm_writes_lt_1ms":40,"peak_mem_usage":0,"rows_written":15700}
I20260615 08:09:24.325739 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1060993 bytes of WAL
I20260615 08:09:24.325850 15667 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:24.326397 15667 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P a4dd9f5055864b28a3998e289ddb3760: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000015 (ops 8651-9247)
I20260615 08:09:24.326866 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:24.327008 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 5290231 bytes on disk
I20260615 08:09:24.327241 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":38,"lbm_reads_lt_1ms":8}
I20260615 08:09:24.327524 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.009795
I20260615 08:09:24.479038 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.651s user 0.489s sys 0.050s Metrics: {"bytes_written":12725610,"cfile_cache_hit":14,"cfile_cache_hit_bytes":1047705,"cfile_cache_miss":556,"cfile_cache_miss_bytes":32495125,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":17565,"dirs.run_cpu_time_us":126,"dirs.run_wall_time_us":571,"drs_written":1,"lbm_read_time_us":17893,"lbm_reads_lt_1ms":576,"lbm_write_time_us":28611,"lbm_writes_lt_1ms":559,"num_input_rowsets":2,"peak_mem_usage":7357921,"rows_written":457450,"spinlock_wait_cycles":1900800,"thread_start_us":57,"threads_started":1}
I20260615 08:09:24.479364 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 5165630 bytes on disk
I20260615 08:09:24.479600 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20260615 08:09:24.479779 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:24.506911 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.027s user 0.021s sys 0.004s Metrics: {"bytes_written":505848,"cfile_init":1,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1312,"lbm_writes_lt_1ms":42,"peak_mem_usage":0,"rows_written":17700}
I20260615 08:09:24.508649 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1086263 bytes of WAL
I20260615 08:09:24.508818 15591 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:24.509198 15591 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000016 (ops 8831-9428)
I20260615 08:09:24.509757 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:24.509903 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 169378 bytes on disk
I20260615 08:09:24.511066 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4}
I20260615 08:09:24.511278 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.009889
I20260615 08:09:24.726414 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.607s user 0.492s sys 0.044s Metrics: {"bytes_written":12946417,"cfile_cache_hit":11,"cfile_cache_hit_bytes":586826,"cfile_cache_miss":569,"cfile_cache_miss_bytes":33519524,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":15536,"dirs.run_cpu_time_us":112,"dirs.run_wall_time_us":1309,"drs_written":1,"lbm_read_time_us":14551,"lbm_reads_lt_1ms":589,"lbm_write_time_us":25159,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":569,"num_input_rowsets":2,"peak_mem_usage":7480290,"rows_written":465400,"spinlock_wait_cycles":3571712,"thread_start_us":60,"threads_started":1}
I20260615 08:09:24.726922 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 5258519 bytes on disk
I20260615 08:09:24.727247 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20260615 08:09:24.727429 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:24.757140 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.030s user 0.022s sys 0.000s Metrics: {"bytes_written":469045,"cfile_init":1,"dirs.queue_time_us":24,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1090,"lbm_writes_lt_1ms":40,"peak_mem_usage":0,"rows_written":16400}
I20260615 08:09:24.757606 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1114215 bytes of WAL
I20260615 08:09:24.757797 15742 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:24.757895 15742 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 4d643312c2624f1f9426f230a68981b0: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000015 (ops 8888-9523)
I20260615 08:09:24.758383 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:24.758551 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.009897
I20260615 08:09:25.266649 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.939s user 0.497s sys 0.055s Metrics: {"bytes_written":13101892,"cfile_cache_hit":12,"cfile_cache_hit_bytes":728143,"cfile_cache_miss":574,"cfile_cache_miss_bytes":33809213,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":310,"dirs.run_cpu_time_us":122,"dirs.run_wall_time_us":14408,"drs_written":1,"lbm_read_time_us":33962,"lbm_reads_1-10_ms":6,"lbm_reads_lt_1ms":588,"lbm_write_time_us":39777,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":575,"num_input_rowsets":2,"peak_mem_usage":7576898,"rows_written":471050,"spinlock_wait_cycles":11746944,"thread_start_us":255,"threads_started":6}
I20260615 08:09:25.267320 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 5322944 bytes on disk
I20260615 08:09:25.267504 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4}
I20260615 08:09:25.267635 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=2.929465
I20260615 08:09:25.336674 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.578s user 0.521s sys 0.047s Metrics: {"bytes_written":13397435,"cfile_cache_hit":11,"cfile_cache_hit_bytes":579919,"cfile_cache_miss":591,"cfile_cache_miss_bytes":34747769,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":55,"dirs.run_cpu_time_us":152,"dirs.run_wall_time_us":640,"drs_written":1,"lbm_read_time_us":17560,"lbm_reads_lt_1ms":615,"lbm_write_time_us":24739,"lbm_writes_lt_1ms":588,"num_input_rowsets":2,"peak_mem_usage":7752528,"rows_written":481800,"spinlock_wait_cycles":477952,"thread_start_us":862,"threads_started":5}
I20260615 08:09:25.336949 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.937278
I20260615 08:09:25.350348 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.083s user 0.031s sys 0.003s Metrics: {"bytes_written":808411,"cfile_init":1,"dirs.queue_time_us":21,"dirs.run_cpu_time_us":76,"dirs.run_wall_time_us":384,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":4343,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":53,"peak_mem_usage":0,"rows_written":28400}
I20260615 08:09:25.350577 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1263384 bytes of WAL
I20260615 08:09:25.350814 15667 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:25.350862 15667 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P a4dd9f5055864b28a3998e289ddb3760: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-1-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000016 (ops 9248-9969)
I20260615 08:09:25.351311 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:25.351432 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.009763
I20260615 08:09:25.421708 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.085s user 0.023s sys 0.008s Metrics: {"bytes_written":573600,"cfile_init":1,"dirs.queue_time_us":767,"dirs.run_cpu_time_us":112,"dirs.run_wall_time_us":1596,"drs_written":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4,"lbm_write_time_us":38783,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":43,"peak_mem_usage":0,"rows_written":20150}
I20260615 08:09:25.422080 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.009735
I20260615 08:09:25.477119 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.966s user 0.523s sys 0.056s Metrics: {"bytes_written":13211484,"cfile_cache_hit":12,"cfile_cache_hit_bytes":742610,"cfile_cache_miss":580,"cfile_cache_miss_bytes":34090162,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":2709,"dirs.run_cpu_time_us":112,"dirs.run_wall_time_us":2444,"drs_written":1,"lbm_read_time_us":22114,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":599,"lbm_write_time_us":42124,"lbm_writes_1-10_ms":3,"lbm_writes_lt_1ms":578,"num_input_rowsets":2,"peak_mem_usage":7641520,"rows_written":475150,"spinlock_wait_cycles":5166464,"thread_start_us":82,"threads_started":1}
I20260615 08:09:25.477690 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 5370546 bytes on disk
I20260615 08:09:25.478058 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20260615 08:09:25.478223 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=2.929465
I20260615 08:09:25.545521 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.067s user 0.033s sys 0.004s Metrics: {"bytes_written":901575,"cfile_init":1,"dirs.queue_time_us":707,"dirs.run_cpu_time_us":92,"dirs.run_wall_time_us":3920,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":10557,"lbm_writes_1-10_ms":2,"lbm_writes_lt_1ms":55,"peak_mem_usage":0,"rows_written":31800}
I20260615 08:09:25.545854 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 312833 bytes on disk
I20260615 08:09:25.546221 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":24,"lbm_reads_lt_1ms":4}
I20260615 08:09:25.546411 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.009685
I20260615 08:09:26.122197 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.700s user 0.561s sys 0.044s Metrics: {"bytes_written":13953790,"cfile_cache_hit":11,"cfile_cache_hit_bytes":590714,"cfile_cache_miss":613,"cfile_cache_miss_bytes":36207206,"cfile_init":7,"delta_iterators_relevant":4,"dirs.queue_time_us":14586,"dirs.run_cpu_time_us":121,"dirs.run_wall_time_us":551,"drs_written":1,"lbm_read_time_us":22134,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":639,"lbm_write_time_us":31589,"lbm_writes_lt_1ms":612,"num_input_rowsets":2,"peak_mem_usage":8074541,"rows_written":501950,"spinlock_wait_cycles":576896,"thread_start_us":303,"threads_started":6}
I20260615 08:09:26.122833 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 5680991 bytes on disk
I20260615 08:09:26.123342 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":18,"lbm_reads_lt_1ms":4}
I20260615 08:09:26.123534 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.937278
I20260615 08:09:26.181061 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.830s user 0.532s sys 0.047s Metrics: {"bytes_written":13887310,"cfile_cache_hit":13,"cfile_cache_hit_bytes":930883,"cfile_cache_miss":611,"cfile_cache_miss_bytes":35669519,"cfile_init":6,"delta_iterators_relevant":4,"dirs.queue_time_us":10304,"dirs.run_cpu_time_us":121,"dirs.run_wall_time_us":7176,"drs_written":1,"lbm_read_time_us":23171,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":634,"lbm_write_time_us":30909,"lbm_writes_lt_1ms":610,"num_input_rowsets":2,"peak_mem_usage":8025653,"rows_written":499450,"spinlock_wait_cycles":5632,"thread_start_us":373,"threads_started":6}
I20260615 08:09:26.184387 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.937278
I20260615 08:09:26.186105 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.640s user 0.544s sys 0.044s Metrics: {"bytes_written":14092941,"cfile_cache_hit":11,"cfile_cache_hit_bytes":688650,"cfile_cache_miss":619,"cfile_cache_miss_bytes":36455758,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":12913,"dirs.run_cpu_time_us":120,"dirs.run_wall_time_us":1297,"drs_written":1,"lbm_read_time_us":17954,"lbm_reads_lt_1ms":639,"lbm_write_time_us":27665,"lbm_writes_lt_1ms":618,"num_input_rowsets":2,"peak_mem_usage":8144124,"rows_written":506950,"spinlock_wait_cycles":2944,"thread_start_us":348,"threads_started":6}
I20260615 08:09:26.186681 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1067981 bytes of WAL
I20260615 08:09:26.187660 15591 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:26.187775 15591 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000017 (ops 9429-10016)
I20260615 08:09:26.188262 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:26.188413 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:26.191885 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.068s user 0.029s sys 0.000s Metrics: {"bytes_written":577867,"cfile_init":1,"dirs.queue_time_us":5057,"drs_written":1,"lbm_read_time_us":14,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2431,"lbm_writes_lt_1ms":44,"peak_mem_usage":0,"rows_written":20300,"spinlock_wait_cycles":768}
I20260615 08:09:26.192140 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1048631 bytes of WAL
I20260615 08:09:26.192341 15742 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:26.192451 15742 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 4d643312c2624f1f9426f230a68981b0: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000016 (ops 9524-10122)
I20260615 08:09:26.192914 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:26.193066 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 193123 bytes on disk
I20260615 08:09:26.193240 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":23,"lbm_reads_lt_1ms":4}
I20260615 08:09:26.193395 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.009465
I20260615 08:09:26.220965 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.032s user 0.023s sys 0.000s Metrics: {"bytes_written":508320,"cfile_init":1,"dirs.queue_time_us":25,"drs_written":1,"lbm_read_time_us":17,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1072,"lbm_writes_lt_1ms":42,"peak_mem_usage":0,"rows_written":17800}
I20260615 08:09:26.221179 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 5907680 bytes on disk
I20260615 08:09:26.222213 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":34,"lbm_reads_lt_1ms":8}
I20260615 08:09:26.222409 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.009437
I20260615 08:09:26.229893 15667 maintenance_manager.cc:643] P a4dd9f5055864b28a3998e289ddb3760: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.045s user 0.027s sys 0.004s Metrics: {"bytes_written":716260,"cfile_init":1,"dirs.queue_time_us":35,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1482,"lbm_writes_lt_1ms":49,"peak_mem_usage":0,"rows_written":25150}
I20260615 08:09:26.230089 15727 maintenance_manager.cc:419] P a4dd9f5055864b28a3998e289ddb3760: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.009441
I20260615 08:09:26.837345 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.643s user 0.558s sys 0.056s Metrics: {"bytes_written":14516553,"cfile_cache_hit":12,"cfile_cache_hit_bytes":846537,"cfile_cache_miss":636,"cfile_cache_miss_bytes":37442377,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":51,"dirs.run_cpu_time_us":119,"dirs.run_wall_time_us":679,"drs_written":1,"lbm_read_time_us":19024,"lbm_reads_lt_1ms":656,"lbm_write_time_us":31893,"lbm_writes_lt_1ms":635,"num_input_rowsets":2,"peak_mem_usage":8404241,"rows_written":522250,"spinlock_wait_cycles":2176,"thread_start_us":212,"threads_started":5}
I20260615 08:09:26.837707 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
I20260615 08:09:26.873585 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.036s user 0.018s sys 0.004s Metrics: {"bytes_written":443797,"cfile_init":1,"dirs.queue_time_us":23,"dirs.run_cpu_time_us":86,"dirs.run_wall_time_us":8206,"drs_written":1,"lbm_read_time_us":15,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2144,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":39,"peak_mem_usage":0,"rows_written":15400}
I20260615 08:09:26.874418 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1050048 bytes of WAL
I20260615 08:09:26.874589 15742 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:26.874807 15742 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 4d643312c2624f1f9426f230a68981b0: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-2-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000017 (ops 10123-10716)
I20260615 08:09:26.875382 15742 maintenance_manager.cc:643] P 4d643312c2624f1f9426f230a68981b0: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:26.875979 15802 maintenance_manager.cc:419] P 4d643312c2624f1f9426f230a68981b0: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.009255
F20260615 08:09:26.920446 16013 test_workload.cc:305] Already present: key already present
*** Check failure stack trace: ***
*** Aborted at 1781510966 (unix time) try "date -d @1781510966" if you are using GNU date ***
F20260615 08:09:26.926591 16016 test_workload.cc:305] Already present: key already present
*** Check failure stack trace: ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e8000010ab) received by PID 4267 (TID 0x7f9190c68700) from PID 4267; stack trace: ***
F20260615 08:09:26.926591 16016 test_workload.cc:305] Already present: key already presentF20260615 08:09:26.927587 16014 test_workload.cc:305] Already present: key already present
*** Check failure stack trace: ***
@ 0x7f922d0c1980 (unknown) at ??:0
F20260615 08:09:26.926591 16016 test_workload.cc:305] Already present: key already presentF20260615 08:09:26.927587 16014 test_workload.cc:305] Already present: key already presentF20260615 08:09:26.931738 16015 test_workload.cc:305] Already present: key already present
*** Check failure stack trace: ***
@ 0x7f922b36ee87 gsignal at ??:0
@ 0x7f922b3707f1 abort at ??:0
I20260615 08:09:26.944446 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.722s user 0.552s sys 0.049s Metrics: {"bytes_written":14586160,"cfile_cache_hit":11,"cfile_cache_hit_bytes":688482,"cfile_cache_miss":641,"cfile_cache_miss_bytes":37790294,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":10403,"dirs.run_cpu_time_us":105,"dirs.run_wall_time_us":2050,"drs_written":1,"lbm_read_time_us":20825,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":660,"lbm_write_time_us":30478,"lbm_writes_lt_1ms":640,"num_input_rowsets":2,"peak_mem_usage":8447365,"rows_written":524750,"spinlock_wait_cycles":4224,"thread_start_us":288,"threads_started":6}
I20260615 08:09:26.944617 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.000000
@ 0x7f922c1d9dcd google::LogMessage::Fail() at ??:0
@ 0x7f922c1ddb93 google::LogMessage::SendToLog() at ??:0
@ 0x7f922c1d97cc google::LogMessage::Flush() at ??:0
@ 0x7f922c1daf59 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f922da2b6e8 kudu::TestWorkload::GetNumberOfErrors() at ??:0
@ 0x7f922da2e54c kudu::TestWorkload::WriteThread() at ??:0
@ 0x7f922b9f66df (unknown) at ??:0
I20260615 08:09:26.974656 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: FlushMRSOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.029s user 0.020s sys 0.000s Metrics: {"bytes_written":424247,"cfile_init":1,"dirs.queue_time_us":230,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":855,"lbm_writes_lt_1ms":38,"peak_mem_usage":0,"rows_written":14781}
I20260615 08:09:26.974829 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): free 1055104 bytes of WAL
I20260615 08:09:26.974963 15591 log_reader.cc:385] T 2a7cfbffb47d4c6388ffb6b85d9f75f0: removed 1 log segments from log reader
I20260615 08:09:26.974996 15591 log.cc:1079] T 2a7cfbffb47d4c6388ffb6b85d9f75f0 P 371b4da9afb846b5b3c4b9a9e0831650: Deleting log segment in path: /tmp/dist-test-task6fMdr_/test-tmp/txn_participant-itest.0.ShouldGCWals_ParticipantCopyITest.TestCopyParticipantOps_1.1781510637089012-4267-0/minicluster-data/ts-0-root/wals/2a7cfbffb47d4c6388ffb6b85d9f75f0/wal-000000018 (ops 10017-10597)
I20260615 08:09:26.975378 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: LogGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
I20260615 08:09:26.975476 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): 6084230 bytes on disk
I20260615 08:09:26.975665 15591 maintenance_manager.cc:643] P 371b4da9afb846b5b3c4b9a9e0831650: UndoDeltaBlockGCOp(2a7cfbffb47d4c6388ffb6b85d9f75f0) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":33,"lbm_reads_lt_1ms":8}
I20260615 08:09:26.975769 15651 maintenance_manager.cc:419] P 371b4da9afb846b5b3c4b9a9e0831650: Scheduling CompactRowSetsOp(2a7cfbffb47d4c6388ffb6b85d9f75f0): perf score=1.009236
@ 0x7f922d0b66db start_thread at ??:0
@ 0x7f922b45161f clone at ??:0