[==========] Running 4 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 4 tests from TimestampAdvancementITest
[ RUN ] TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260618 20:07:10.972301 11597 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.83.126:41309
I20260618 20:07:10.972682 11597 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260618 20:07:10.972868 11597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260618 20:07:10.976903 11602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:10.977102 11605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:10.977246 11603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 20:07:10.977907 11597 server_base.cc:1061] running on GCE node
I20260618 20:07:10.978216 11597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260618 20:07:10.978262 11597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260618 20:07:10.978283 11597 hybrid_clock.cc:648] HybridClock initialized: now 1781813230978284 us; error 0 us; skew 500 ppm
I20260618 20:07:10.979485 11597 webserver.cc:533] Webserver started at http://127.11.83.126:38483/ using document root <none> and password file <none>
I20260618 20:07:10.979653 11597 fs_manager.cc:362] Metadata directory not provided
I20260618 20:07:10.979723 11597 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 20:07:10.979808 11597 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 20:07:10.980892 11597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781813230966404-11597-0/minicluster-data/master-0-root/instance:
uuid: "9d582095dd02434da9539f9de37c442d"
format_stamp: "Formatted at 2026-06-18 20:07:10 on dist-test-slave-szgn"
I20260618 20:07:10.982372 11597 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260618 20:07:10.983012 11610 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:10.983208 11597 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:10.983294 11597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781813230966404-11597-0/minicluster-data/master-0-root
uuid: "9d582095dd02434da9539f9de37c442d"
format_stamp: "Formatted at 2026-06-18 20:07:10 on dist-test-slave-szgn"
I20260618 20:07:10.983376 11597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781813230966404-11597-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781813230966404-11597-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781813230966404-11597-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 20:07:10.991991 11597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 20:07:10.992369 11597 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260618 20:07:10.992499 11597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 20:07:10.992918 11616 maintenance_manager.cc:346] Maintenance manager is disabled (check --enable_maintenance_manager).
I20260618 20:07:10.998205 11597 rpc_server.cc:307] RPC server started. Bound to: 127.11.83.126:41309
I20260618 20:07:10.998236 11662 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.83.126:41309 every 8 connection(s)
I20260618 20:07:10.999493 11663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 20:07:11.001925 11663 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d582095dd02434da9539f9de37c442d: Bootstrap starting.
I20260618 20:07:11.002871 11663 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9d582095dd02434da9539f9de37c442d: Neither blocks nor log segments found. Creating new log.
I20260618 20:07:11.003147 11663 log.cc:826] T 00000000000000000000000000000000 P 9d582095dd02434da9539f9de37c442d: Log is configured to *not* fsync() on all Append() calls
I20260618 20:07:11.004009 11663 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9d582095dd02434da9539f9de37c442d: No bootstrap required, opened a new log
I20260618 20:07:11.005306 11663 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9d582095dd02434da9539f9de37c442d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d582095dd02434da9539f9de37c442d" member_type: VOTER }
I20260618 20:07:11.005411 11663 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9d582095dd02434da9539f9de37c442d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 20:07:11.005430 11663 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9d582095dd02434da9539f9de37c442d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d582095dd02434da9539f9de37c442d, State: Initialized, Role: FOLLOWER
I20260618 20:07:11.005560 11663 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9d582095dd02434da9539f9de37c442d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d582095dd02434da9539f9de37c442d" member_type: VOTER }
I20260618 20:07:11.005635 11663 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9d582095dd02434da9539f9de37c442d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 20:07:11.005677 11663 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9d582095dd02434da9539f9de37c442d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 20:07:11.005704 11663 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9d582095dd02434da9539f9de37c442d [term 0 FOLLOWER]: Advancing to term 1
I20260618 20:07:11.006342 11663 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9d582095dd02434da9539f9de37c442d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d582095dd02434da9539f9de37c442d" member_type: VOTER }
I20260618 20:07:11.006428 11663 leader_election.cc:304] T 00000000000000000000000000000000 P 9d582095dd02434da9539f9de37c442d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9d582095dd02434da9539f9de37c442d; no voters:
I20260618 20:07:11.006564 11663 leader_election.cc:290] T 00000000000000000000000000000000 P 9d582095dd02434da9539f9de37c442d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 20:07:11.006680 11666 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9d582095dd02434da9539f9de37c442d [term 1 FOLLOWER]: Leader election won for term 1
I20260618 20:07:11.006814 11663 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9d582095dd02434da9539f9de37c442d [sys.catalog]: configured and running, proceeding with master startup.
I20260618 20:07:11.006858 11666 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9d582095dd02434da9539f9de37c442d [term 1 LEADER]: Becoming Leader. State: Replica: 9d582095dd02434da9539f9de37c442d, State: Running, Role: LEADER
I20260618 20:07:11.007058 11666 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9d582095dd02434da9539f9de37c442d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d582095dd02434da9539f9de37c442d" member_type: VOTER }
I20260618 20:07:11.007455 11667 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d582095dd02434da9539f9de37c442d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9d582095dd02434da9539f9de37c442d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d582095dd02434da9539f9de37c442d" member_type: VOTER } }
I20260618 20:07:11.007485 11668 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9d582095dd02434da9539f9de37c442d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9d582095dd02434da9539f9de37c442d. Latest consensus state: current_term: 1 leader_uuid: "9d582095dd02434da9539f9de37c442d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9d582095dd02434da9539f9de37c442d" member_type: VOTER } }
I20260618 20:07:11.007606 11668 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d582095dd02434da9539f9de37c442d [sys.catalog]: This master's current role is: LEADER
I20260618 20:07:11.007787 11667 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9d582095dd02434da9539f9de37c442d [sys.catalog]: This master's current role is: LEADER
I20260618 20:07:11.007949 11675 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260618 20:07:11.008416 11675 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260618 20:07:11.008533 11597 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260618 20:07:11.009887 11675 catalog_manager.cc:1382] Generated new cluster ID: 05c5a127ab4149e69c5cd12c2ff70935
I20260618 20:07:11.009929 11675 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260618 20:07:11.021001 11675 catalog_manager.cc:1405] Generated new certificate authority record
I20260618 20:07:11.021629 11675 catalog_manager.cc:1539] Loading token signing keys...
I20260618 20:07:11.027297 11675 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 9d582095dd02434da9539f9de37c442d: Generated new TSK 0
I20260618 20:07:11.027506 11675 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260618 20:07:11.040661 11597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260618 20:07:11.040865 11597 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260618 20:07:11.042464 11688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:11.042544 11686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:11.042552 11685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 20:07:11.043244 11597 server_base.cc:1061] running on GCE node
I20260618 20:07:11.043395 11597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260618 20:07:11.043434 11597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260618 20:07:11.043462 11597 hybrid_clock.cc:648] HybridClock initialized: now 1781813231043462 us; error 0 us; skew 500 ppm
I20260618 20:07:11.044257 11597 webserver.cc:533] Webserver started at http://127.11.83.65:45369/ using document root <none> and password file <none>
I20260618 20:07:11.044355 11597 fs_manager.cc:362] Metadata directory not provided
I20260618 20:07:11.044411 11597 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 20:07:11.044462 11597 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 20:07:11.044739 11597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781813230966404-11597-0/minicluster-data/ts-0-root/instance:
uuid: "55ab28c109574af3998578604ff7aac1"
format_stamp: "Formatted at 2026-06-18 20:07:11 on dist-test-slave-szgn"
I20260618 20:07:11.045756 11597 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260618 20:07:11.046434 11693 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:11.046665 11597 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:11.046772 11597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781813230966404-11597-0/minicluster-data/ts-0-root
uuid: "55ab28c109574af3998578604ff7aac1"
format_stamp: "Formatted at 2026-06-18 20:07:11 on dist-test-slave-szgn"
I20260618 20:07:11.046844 11597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781813230966404-11597-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781813230966404-11597-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781813230966404-11597-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 20:07:11.061506 11597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 20:07:11.061828 11597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 20:07:11.062093 11597 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260618 20:07:11.062479 11597 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 20:07:11.062515 11597 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:11.062539 11597 ts_tablet_manager.cc:616] Registered 0 tablets
I20260618 20:07:11.062578 11597 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:11.067282 11597 rpc_server.cc:307] RPC server started. Bound to: 127.11.83.65:38817
I20260618 20:07:11.067353 11756 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.83.65:38817 every 8 connection(s)
I20260618 20:07:11.067750 11597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260618 20:07:11.067873 11597 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260618 20:07:11.069763 11760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:11.070099 11762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:11.070124 11764 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 20:07:11.070317 11597 server_base.cc:1061] running on GCE node
I20260618 20:07:11.070509 11597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260618 20:07:11.070555 11597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260618 20:07:11.070607 11597 hybrid_clock.cc:648] HybridClock initialized: now 1781813231070607 us; error 0 us; skew 500 ppm
I20260618 20:07:11.071317 11597 webserver.cc:533] Webserver started at http://127.11.83.66:39927/ using document root <none> and password file <none>
I20260618 20:07:11.071408 11597 fs_manager.cc:362] Metadata directory not provided
I20260618 20:07:11.071455 11597 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 20:07:11.071507 11597 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 20:07:11.071848 11597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781813230966404-11597-0/minicluster-data/ts-1-root/instance:
uuid: "7943481f339048bc9fc0a13855b76d2d"
format_stamp: "Formatted at 2026-06-18 20:07:11 on dist-test-slave-szgn"
I20260618 20:07:11.072875 11597 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260618 20:07:11.073488 11769 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:11.073704 11597 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:11.073822 11597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781813230966404-11597-0/minicluster-data/ts-1-root
uuid: "7943481f339048bc9fc0a13855b76d2d"
format_stamp: "Formatted at 2026-06-18 20:07:11 on dist-test-slave-szgn"
I20260618 20:07:11.073879 11597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781813230966404-11597-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781813230966404-11597-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781813230966404-11597-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 20:07:11.076556 11757 heartbeater.cc:344] Connected to a master server at 127.11.83.126:41309
I20260618 20:07:11.076659 11757 heartbeater.cc:461] Registering TS with master...
I20260618 20:07:11.076905 11757 heartbeater.cc:507] Master 127.11.83.126:41309 requested a full tablet report, sending...
I20260618 20:07:11.077498 11619 ts_manager.cc:194] Registered new tserver with Master: 55ab28c109574af3998578604ff7aac1 (127.11.83.65:38817)
I20260618 20:07:11.078651 11619 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36784
I20260618 20:07:11.079107 11597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 20:07:11.079382 11597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 20:07:11.079607 11597 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260618 20:07:11.079886 11597 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 20:07:11.079945 11597 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:11.079989 11597 ts_tablet_manager.cc:616] Registered 0 tablets
I20260618 20:07:11.080016 11597 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:11.084326 11597 rpc_server.cc:307] RPC server started. Bound to: 127.11.83.66:44039
I20260618 20:07:11.084412 11832 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.83.66:44039 every 8 connection(s)
I20260618 20:07:11.084833 11597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260618 20:07:11.084959 11597 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260618 20:07:11.086962 11839 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 20:07:11.087013 11597 server_base.cc:1061] running on GCE node
W20260618 20:07:11.087219 11837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:11.087206 11836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 20:07:11.087533 11597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260618 20:07:11.087600 11597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260618 20:07:11.087628 11597 hybrid_clock.cc:648] HybridClock initialized: now 1781813231087629 us; error 0 us; skew 500 ppm
I20260618 20:07:11.088336 11597 webserver.cc:533] Webserver started at http://127.11.83.67:37151/ using document root <none> and password file <none>
I20260618 20:07:11.088429 11597 fs_manager.cc:362] Metadata directory not provided
I20260618 20:07:11.088472 11597 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 20:07:11.088514 11597 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 20:07:11.088876 11597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781813230966404-11597-0/minicluster-data/ts-2-root/instance:
uuid: "93bd9ee65f5041a78ccd58d7e335605d"
format_stamp: "Formatted at 2026-06-18 20:07:11 on dist-test-slave-szgn"
I20260618 20:07:11.089354 11833 heartbeater.cc:344] Connected to a master server at 127.11.83.126:41309
I20260618 20:07:11.089409 11833 heartbeater.cc:461] Registering TS with master...
I20260618 20:07:11.089511 11833 heartbeater.cc:507] Master 127.11.83.126:41309 requested a full tablet report, sending...
I20260618 20:07:11.089792 11619 ts_manager.cc:194] Registered new tserver with Master: 7943481f339048bc9fc0a13855b76d2d (127.11.83.66:44039)
I20260618 20:07:11.090117 11597 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260618 20:07:11.090319 11619 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36796
I20260618 20:07:11.090901 11844 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:11.091068 11597 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260618 20:07:11.091138 11597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781813230966404-11597-0/minicluster-data/ts-2-root
uuid: "93bd9ee65f5041a78ccd58d7e335605d"
format_stamp: "Formatted at 2026-06-18 20:07:11 on dist-test-slave-szgn"
I20260618 20:07:11.091194 11597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781813230966404-11597-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781813230966404-11597-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781813230966404-11597-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 20:07:11.106666 11597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 20:07:11.106983 11597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 20:07:11.107190 11597 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260618 20:07:11.107458 11597 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 20:07:11.107507 11597 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:11.107551 11597 ts_tablet_manager.cc:616] Registered 0 tablets
I20260618 20:07:11.107578 11597 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:11.112046 11597 rpc_server.cc:307] RPC server started. Bound to: 127.11.83.67:43463
I20260618 20:07:11.112116 11907 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.83.67:43463 every 8 connection(s)
I20260618 20:07:11.117731 11908 heartbeater.cc:344] Connected to a master server at 127.11.83.126:41309
I20260618 20:07:11.117843 11908 heartbeater.cc:461] Registering TS with master...
I20260618 20:07:11.118124 11908 heartbeater.cc:507] Master 127.11.83.126:41309 requested a full tablet report, sending...
I20260618 20:07:11.118423 11619 ts_manager.cc:194] Registered new tserver with Master: 93bd9ee65f5041a78ccd58d7e335605d (127.11.83.67:43463)
I20260618 20:07:11.118937 11619 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36812
I20260618 20:07:11.119097 11597 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.006863733s
I20260618 20:07:11.136293 11619 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36840:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260618 20:07:11.136595 11619 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 20:07:11.143438 11797 tablet_service.cc:1511] Processing CreateTablet for tablet adf27860270e4db1ae9ee6f46ea997fe (DEFAULT_TABLE table=test-workload [id=6f1b424b1e8a47ba9d0186a887556ec9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 20:07:11.143438 11721 tablet_service.cc:1511] Processing CreateTablet for tablet adf27860270e4db1ae9ee6f46ea997fe (DEFAULT_TABLE table=test-workload [id=6f1b424b1e8a47ba9d0186a887556ec9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 20:07:11.143910 11721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adf27860270e4db1ae9ee6f46ea997fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 20:07:11.143910 11797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adf27860270e4db1ae9ee6f46ea997fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 20:07:11.146176 11929 tablet_bootstrap.cc:492] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1: Bootstrap starting.
I20260618 20:07:11.146760 11929 tablet_bootstrap.cc:654] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1: Neither blocks nor log segments found. Creating new log.
I20260618 20:07:11.147418 11931 tablet_bootstrap.cc:492] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d: Bootstrap starting.
I20260618 20:07:11.147749 11872 tablet_service.cc:1511] Processing CreateTablet for tablet adf27860270e4db1ae9ee6f46ea997fe (DEFAULT_TABLE table=test-workload [id=6f1b424b1e8a47ba9d0186a887556ec9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 20:07:11.147898 11872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adf27860270e4db1ae9ee6f46ea997fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 20:07:11.147738 11929 tablet_bootstrap.cc:492] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1: No bootstrap required, opened a new log
I20260618 20:07:11.148027 11929 ts_tablet_manager.cc:1403] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260618 20:07:11.148259 11931 tablet_bootstrap.cc:654] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d: Neither blocks nor log segments found. Creating new log.
I20260618 20:07:11.148211 11929 raft_consensus.cc:359] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:11.148306 11929 raft_consensus.cc:385] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 20:07:11.148329 11929 raft_consensus.cc:740] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55ab28c109574af3998578604ff7aac1, State: Initialized, Role: FOLLOWER
I20260618 20:07:11.148393 11929 consensus_queue.cc:260] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:11.148622 11929 ts_tablet_manager.cc:1434] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260618 20:07:11.148770 11757 heartbeater.cc:499] Master 127.11.83.126:41309 was elected leader, sending a full tablet report...
I20260618 20:07:11.149416 11934 tablet_bootstrap.cc:492] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d: Bootstrap starting.
I20260618 20:07:11.149631 11931 tablet_bootstrap.cc:492] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d: No bootstrap required, opened a new log
I20260618 20:07:11.149936 11931 ts_tablet_manager.cc:1403] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260618 20:07:11.150233 11931 raft_consensus.cc:359] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:11.150326 11931 raft_consensus.cc:385] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 20:07:11.150372 11931 raft_consensus.cc:740] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7943481f339048bc9fc0a13855b76d2d, State: Initialized, Role: FOLLOWER
I20260618 20:07:11.150382 11934 tablet_bootstrap.cc:654] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d: Neither blocks nor log segments found. Creating new log.
I20260618 20:07:11.150478 11931 consensus_queue.cc:260] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:11.150682 11833 heartbeater.cc:499] Master 127.11.83.126:41309 was elected leader, sending a full tablet report...
I20260618 20:07:11.150662 11931 ts_tablet_manager.cc:1434] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260618 20:07:11.151221 11934 tablet_bootstrap.cc:492] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d: No bootstrap required, opened a new log
I20260618 20:07:11.151271 11934 ts_tablet_manager.cc:1403] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260618 20:07:11.151422 11934 raft_consensus.cc:359] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:11.151505 11934 raft_consensus.cc:385] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 20:07:11.151540 11934 raft_consensus.cc:740] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93bd9ee65f5041a78ccd58d7e335605d, State: Initialized, Role: FOLLOWER
I20260618 20:07:11.151600 11934 consensus_queue.cc:260] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:11.151782 11934 ts_tablet_manager.cc:1434] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260618 20:07:11.151836 11908 heartbeater.cc:499] Master 127.11.83.126:41309 was elected leader, sending a full tablet report...
I20260618 20:07:11.158771 11935 raft_consensus.cc:493] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 20:07:11.158907 11935 raft_consensus.cc:515] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:11.159229 11935 leader_election.cc:290] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93bd9ee65f5041a78ccd58d7e335605d (127.11.83.67:43463), 55ab28c109574af3998578604ff7aac1 (127.11.83.65:38817)
I20260618 20:07:11.162554 11882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "7943481f339048bc9fc0a13855b76d2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93bd9ee65f5041a78ccd58d7e335605d" is_pre_election: true
I20260618 20:07:11.162670 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "7943481f339048bc9fc0a13855b76d2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55ab28c109574af3998578604ff7aac1" is_pre_election: true
I20260618 20:07:11.162731 11882 raft_consensus.cc:2468] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7943481f339048bc9fc0a13855b76d2d in term 0.
I20260618 20:07:11.162730 11731 raft_consensus.cc:2468] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7943481f339048bc9fc0a13855b76d2d in term 0.
I20260618 20:07:11.162945 11771 leader_election.cc:304] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55ab28c109574af3998578604ff7aac1, 7943481f339048bc9fc0a13855b76d2d; no voters:
I20260618 20:07:11.163039 11935 raft_consensus.cc:2804] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 20:07:11.163082 11935 raft_consensus.cc:493] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 20:07:11.163115 11935 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 0 FOLLOWER]: Advancing to term 1
I20260618 20:07:11.163784 11935 raft_consensus.cc:515] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:11.164000 11935 leader_election.cc:290] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [CANDIDATE]: Term 1 election: Requested vote from peers 93bd9ee65f5041a78ccd58d7e335605d (127.11.83.67:43463), 55ab28c109574af3998578604ff7aac1 (127.11.83.65:38817)
I20260618 20:07:11.164095 11882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "7943481f339048bc9fc0a13855b76d2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93bd9ee65f5041a78ccd58d7e335605d"
I20260618 20:07:11.164131 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "7943481f339048bc9fc0a13855b76d2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55ab28c109574af3998578604ff7aac1"
I20260618 20:07:11.164217 11882 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 0 FOLLOWER]: Advancing to term 1
I20260618 20:07:11.164228 11731 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 0 FOLLOWER]: Advancing to term 1
I20260618 20:07:11.164963 11731 raft_consensus.cc:2468] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7943481f339048bc9fc0a13855b76d2d in term 1.
I20260618 20:07:11.165055 11882 raft_consensus.cc:2468] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7943481f339048bc9fc0a13855b76d2d in term 1.
I20260618 20:07:11.165145 11771 leader_election.cc:304] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55ab28c109574af3998578604ff7aac1, 7943481f339048bc9fc0a13855b76d2d; no voters:
I20260618 20:07:11.165216 11935 raft_consensus.cc:2804] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 1 FOLLOWER]: Leader election won for term 1
I20260618 20:07:11.165421 11935 raft_consensus.cc:697] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 1 LEADER]: Becoming Leader. State: Replica: 7943481f339048bc9fc0a13855b76d2d, State: Running, Role: LEADER
I20260618 20:07:11.165596 11935 consensus_queue.cc:237] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:11.166460 11627 catalog_manager.cc:5696] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7943481f339048bc9fc0a13855b76d2d (127.11.83.66). New cstate: current_term: 1 leader_uuid: "7943481f339048bc9fc0a13855b76d2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } health_report { overall_health: UNKNOWN } } }
I20260618 20:07:11.181596 11882 raft_consensus.cc:1275] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 1 FOLLOWER]: Refusing update from remote peer 7943481f339048bc9fc0a13855b76d2d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260618 20:07:11.181596 11731 raft_consensus.cc:1275] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 1 FOLLOWER]: Refusing update from remote peer 7943481f339048bc9fc0a13855b76d2d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 20:07:11.181947 11939 consensus_queue.cc:1048] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 20:07:11.182097 11947 consensus_queue.cc:1048] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 20:07:11.194329 11597 tablet.cc:1622] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1: MemRowSet was empty: no flush needed.
I20260618 20:07:11.201968 11597 test_workload.cc:405] TestWorkload: Skipping table creation because table test-workload already exists
I20260618 20:07:11.491797 11937 raft_consensus.cc:493] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7943481f339048bc9fc0a13855b76d2d)
I20260618 20:07:11.491922 11937 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 1 FOLLOWER]: Advancing to term 2
I20260618 20:07:11.492695 11937 raft_consensus.cc:515] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:11.492969 11937 leader_election.cc:290] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [CANDIDATE]: Term 2 election: Requested vote from peers 7943481f339048bc9fc0a13855b76d2d (127.11.83.66:44039), 55ab28c109574af3998578604ff7aac1 (127.11.83.65:38817)
I20260618 20:07:11.496313 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "93bd9ee65f5041a78ccd58d7e335605d" candidate_term: 2 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "55ab28c109574af3998578604ff7aac1"
I20260618 20:07:11.496318 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "93bd9ee65f5041a78ccd58d7e335605d" candidate_term: 2 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "7943481f339048bc9fc0a13855b76d2d"
I20260618 20:07:11.496628 11847 leader_election.cc:304] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93bd9ee65f5041a78ccd58d7e335605d; no voters: 55ab28c109574af3998578604ff7aac1, 7943481f339048bc9fc0a13855b76d2d
I20260618 20:07:11.496785 11937 raft_consensus.cc:2749] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260618 20:07:11.509745 11882 raft_consensus.cc:1240] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 2 FOLLOWER]: Rejecting Update request from peer 7943481f339048bc9fc0a13855b76d2d for earlier term 1. Current term is 2. Ops: []
I20260618 20:07:11.510087 11939 consensus_queue.cc:1059] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 }, Status: INVALID_TERM, Last received: 1.41, Next index: 42, Last known committed idx: 41, Time since last communication: 0.000s
W20260618 20:07:11.510226 11939 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20260618 20:07:11.510243 11939 fault_injection.cc:44] THIS SERVER MAY CRASH!
I20260618 20:07:11.527007 11932 raft_consensus.cc:493] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7943481f339048bc9fc0a13855b76d2d)
I20260618 20:07:11.527112 11932 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 1 FOLLOWER]: Advancing to term 2
I20260618 20:07:11.527913 11932 raft_consensus.cc:515] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:11.528146 11932 leader_election.cc:290] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [CANDIDATE]: Term 2 election: Requested vote from peers 93bd9ee65f5041a78ccd58d7e335605d (127.11.83.67:43463), 7943481f339048bc9fc0a13855b76d2d (127.11.83.66:44039)
I20260618 20:07:11.531301 11882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "55ab28c109574af3998578604ff7aac1" candidate_term: 2 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "93bd9ee65f5041a78ccd58d7e335605d"
I20260618 20:07:11.531365 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "55ab28c109574af3998578604ff7aac1" candidate_term: 2 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "7943481f339048bc9fc0a13855b76d2d"
I20260618 20:07:11.531426 11882 raft_consensus.cc:2393] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 55ab28c109574af3998578604ff7aac1 in current term 2: Already voted for candidate 93bd9ee65f5041a78ccd58d7e335605d in this term.
I20260618 20:07:11.531587 11696 leader_election.cc:304] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55ab28c109574af3998578604ff7aac1; no voters: 7943481f339048bc9fc0a13855b76d2d, 93bd9ee65f5041a78ccd58d7e335605d
I20260618 20:07:11.531718 11932 raft_consensus.cc:2749] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260618 20:07:11.532634 11731 raft_consensus.cc:1240] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 2 FOLLOWER]: Rejecting Update request from peer 7943481f339048bc9fc0a13855b76d2d for earlier term 1. Current term is 2. Ops: []
I20260618 20:07:11.532913 11935 consensus_queue.cc:1059] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 }, Status: INVALID_TERM, Last received: 1.41, Next index: 42, Last known committed idx: 41, Time since last communication: 0.000s
I20260618 20:07:11.544392 11939 raft_consensus.cc:3055] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 1 LEADER]: Stepping down as leader of term 1
I20260618 20:07:11.544512 11939 raft_consensus.cc:740] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7943481f339048bc9fc0a13855b76d2d, State: Running, Role: LEADER
I20260618 20:07:11.544590 11939 consensus_queue.cc:260] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 41, Committed index: 41, Last appended: 1.41, Last appended by leader: 41, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:11.544742 11939 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 1 FOLLOWER]: Advancing to term 2
I20260618 20:07:11.612310 11937 raft_consensus.cc:493] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 20:07:11.612450 11937 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 2 FOLLOWER]: Advancing to term 3
I20260618 20:07:11.613300 11937 raft_consensus.cc:515] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:11.613551 11937 leader_election.cc:290] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [CANDIDATE]: Term 3 election: Requested vote from peers 7943481f339048bc9fc0a13855b76d2d (127.11.83.66:44039), 55ab28c109574af3998578604ff7aac1 (127.11.83.65:38817)
I20260618 20:07:11.613807 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "93bd9ee65f5041a78ccd58d7e335605d" candidate_term: 3 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "55ab28c109574af3998578604ff7aac1"
I20260618 20:07:11.613884 11731 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 2 FOLLOWER]: Advancing to term 3
I20260618 20:07:11.613812 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "93bd9ee65f5041a78ccd58d7e335605d" candidate_term: 3 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "7943481f339048bc9fc0a13855b76d2d"
I20260618 20:07:11.614058 11807 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 2 FOLLOWER]: Advancing to term 3
I20260618 20:07:11.614709 11731 raft_consensus.cc:2468] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93bd9ee65f5041a78ccd58d7e335605d in term 3.
I20260618 20:07:11.614733 11807 raft_consensus.cc:2468] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93bd9ee65f5041a78ccd58d7e335605d in term 3.
I20260618 20:07:11.614954 11846 leader_election.cc:304] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55ab28c109574af3998578604ff7aac1, 93bd9ee65f5041a78ccd58d7e335605d; no voters:
I20260618 20:07:11.615072 11937 raft_consensus.cc:2804] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 3 FOLLOWER]: Leader election won for term 3
I20260618 20:07:11.615202 11937 raft_consensus.cc:697] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 3 LEADER]: Becoming Leader. State: Replica: 93bd9ee65f5041a78ccd58d7e335605d, State: Running, Role: LEADER
I20260618 20:07:11.615285 11937 consensus_queue.cc:237] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 41, Committed index: 41, Last appended: 1.41, Last appended by leader: 41, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:11.615844 11625 catalog_manager.cc:5696] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d reported cstate change: term changed from 1 to 3, leader changed from 7943481f339048bc9fc0a13855b76d2d (127.11.83.66) to 93bd9ee65f5041a78ccd58d7e335605d (127.11.83.67). New cstate: current_term: 3 leader_uuid: "93bd9ee65f5041a78ccd58d7e335605d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } health_report { overall_health: UNKNOWN } } }
I20260618 20:07:11.697247 11731 raft_consensus.cc:1275] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 3 FOLLOWER]: Refusing update from remote peer 93bd9ee65f5041a78ccd58d7e335605d: Log matching property violated. Preceding OpId in replica: term: 1 index: 41. Preceding OpId from leader: term: 3 index: 42. (index mismatch)
I20260618 20:07:11.697547 11937 consensus_queue.cc:1048] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [LEADER]: Connected to new peer: Peer: permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 42, Last known committed idx: 41, Time since last communication: 0.000s
I20260618 20:07:11.709666 11807 raft_consensus.cc:1275] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 3 FOLLOWER]: Refusing update from remote peer 93bd9ee65f5041a78ccd58d7e335605d: Log matching property violated. Preceding OpId in replica: term: 1 index: 41. Preceding OpId from leader: term: 3 index: 42. (index mismatch)
I20260618 20:07:11.709985 11937 consensus_queue.cc:1048] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 42, Last known committed idx: 41, Time since last communication: 0.000s
I20260618 20:07:11.811542 11939 raft_consensus.cc:493] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 93bd9ee65f5041a78ccd58d7e335605d)
I20260618 20:07:11.811676 11939 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 3 FOLLOWER]: Advancing to term 4
I20260618 20:07:11.812439 11939 raft_consensus.cc:515] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:11.812927 11939 leader_election.cc:290] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [CANDIDATE]: Term 4 election: Requested vote from peers 93bd9ee65f5041a78ccd58d7e335605d (127.11.83.67:43463), 55ab28c109574af3998578604ff7aac1 (127.11.83.65:38817)
I20260618 20:07:11.813230 11882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "7943481f339048bc9fc0a13855b76d2d" candidate_term: 4 candidate_status { last_received { term: 3 index: 42 } } ignore_live_leader: false dest_uuid: "93bd9ee65f5041a78ccd58d7e335605d"
I20260618 20:07:11.813237 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "7943481f339048bc9fc0a13855b76d2d" candidate_term: 4 candidate_status { last_received { term: 3 index: 42 } } ignore_live_leader: false dest_uuid: "55ab28c109574af3998578604ff7aac1"
I20260618 20:07:11.813663 11771 leader_election.cc:304] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7943481f339048bc9fc0a13855b76d2d; no voters: 55ab28c109574af3998578604ff7aac1, 93bd9ee65f5041a78ccd58d7e335605d
I20260618 20:07:11.813879 11939 raft_consensus.cc:2749] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260618 20:07:11.821290 11807 raft_consensus.cc:1240] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 4 FOLLOWER]: Rejecting Update request from peer 93bd9ee65f5041a78ccd58d7e335605d for earlier term 3. Current term is 4. Ops: []
I20260618 20:07:11.821736 11976 consensus_queue.cc:1059] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 }, Status: INVALID_TERM, Last received: 3.42, Next index: 43, Last known committed idx: 42, Time since last communication: 0.000s
I20260618 20:07:11.889163 11932 raft_consensus.cc:493] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 93bd9ee65f5041a78ccd58d7e335605d)
I20260618 20:07:11.889281 11932 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 3 FOLLOWER]: Advancing to term 4
I20260618 20:07:11.890298 11932 raft_consensus.cc:515] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:11.890522 11932 leader_election.cc:290] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [CANDIDATE]: Term 4 election: Requested vote from peers 93bd9ee65f5041a78ccd58d7e335605d (127.11.83.67:43463), 7943481f339048bc9fc0a13855b76d2d (127.11.83.66:44039)
I20260618 20:07:11.890812 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "55ab28c109574af3998578604ff7aac1" candidate_term: 4 candidate_status { last_received { term: 3 index: 42 } } ignore_live_leader: false dest_uuid: "7943481f339048bc9fc0a13855b76d2d"
I20260618 20:07:11.890920 11807 raft_consensus.cc:2393] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 55ab28c109574af3998578604ff7aac1 in current term 4: Already voted for candidate 7943481f339048bc9fc0a13855b76d2d in this term.
I20260618 20:07:11.890817 11882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "55ab28c109574af3998578604ff7aac1" candidate_term: 4 candidate_status { last_received { term: 3 index: 42 } } ignore_live_leader: false dest_uuid: "93bd9ee65f5041a78ccd58d7e335605d"
I20260618 20:07:11.891083 11731 raft_consensus.cc:1240] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 4 FOLLOWER]: Rejecting Update request from peer 93bd9ee65f5041a78ccd58d7e335605d for earlier term 3. Current term is 4. Ops: []
I20260618 20:07:11.891148 11696 leader_election.cc:304] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55ab28c109574af3998578604ff7aac1; no voters: 7943481f339048bc9fc0a13855b76d2d, 93bd9ee65f5041a78ccd58d7e335605d
I20260618 20:07:11.891263 11932 raft_consensus.cc:2749] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260618 20:07:11.891317 11937 consensus_queue.cc:1059] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 }, Status: INVALID_TERM, Last received: 3.42, Next index: 43, Last known committed idx: 42, Time since last communication: 0.000s
I20260618 20:07:11.901278 11807 raft_consensus.cc:1240] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 4 FOLLOWER]: Rejecting Update request from peer 93bd9ee65f5041a78ccd58d7e335605d for earlier term 3. Current term is 4. Ops: []
I20260618 20:07:11.901612 11937 consensus_queue.cc:1059] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 }, Status: INVALID_TERM, Last received: 3.42, Next index: 43, Last known committed idx: 42, Time since last communication: 0.000s
I20260618 20:07:11.937768 11939 raft_consensus.cc:493] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 20:07:11.937898 11939 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 4 FOLLOWER]: Advancing to term 5
I20260618 20:07:11.938694 11939 raft_consensus.cc:515] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:11.938946 11939 leader_election.cc:290] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [CANDIDATE]: Term 5 election: Requested vote from peers 93bd9ee65f5041a78ccd58d7e335605d (127.11.83.67:43463), 55ab28c109574af3998578604ff7aac1 (127.11.83.65:38817)
I20260618 20:07:11.939152 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "7943481f339048bc9fc0a13855b76d2d" candidate_term: 5 candidate_status { last_received { term: 3 index: 42 } } ignore_live_leader: false dest_uuid: "55ab28c109574af3998578604ff7aac1"
I20260618 20:07:11.939230 11882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "7943481f339048bc9fc0a13855b76d2d" candidate_term: 5 candidate_status { last_received { term: 3 index: 42 } } ignore_live_leader: false dest_uuid: "93bd9ee65f5041a78ccd58d7e335605d"
I20260618 20:07:11.939275 11731 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 4 FOLLOWER]: Advancing to term 5
I20260618 20:07:11.939972 11731 raft_consensus.cc:2468] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7943481f339048bc9fc0a13855b76d2d in term 5.
I20260618 20:07:11.940218 11771 leader_election.cc:304] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55ab28c109574af3998578604ff7aac1, 7943481f339048bc9fc0a13855b76d2d; no voters: 93bd9ee65f5041a78ccd58d7e335605d
I20260618 20:07:11.940338 11939 raft_consensus.cc:2804] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 5 FOLLOWER]: Leader election won for term 5
I20260618 20:07:11.940423 11939 raft_consensus.cc:697] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 5 LEADER]: Becoming Leader. State: Replica: 7943481f339048bc9fc0a13855b76d2d, State: Running, Role: LEADER
I20260618 20:07:11.940485 11939 consensus_queue.cc:237] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 42, Committed index: 42, Last appended: 3.42, Last appended by leader: 42, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:11.940968 11625 catalog_manager.cc:5696] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d reported cstate change: term changed from 3 to 5, leader changed from 93bd9ee65f5041a78ccd58d7e335605d (127.11.83.67) to 7943481f339048bc9fc0a13855b76d2d (127.11.83.66). New cstate: current_term: 5 leader_uuid: "7943481f339048bc9fc0a13855b76d2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } health_report { overall_health: UNKNOWN } } }
I20260618 20:07:11.964591 11977 raft_consensus.cc:3055] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 3 LEADER]: Stepping down as leader of term 3
I20260618 20:07:11.964699 11977 raft_consensus.cc:740] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 93bd9ee65f5041a78ccd58d7e335605d, State: Running, Role: LEADER
I20260618 20:07:11.964869 11977 consensus_queue.cc:260] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 42, Committed index: 42, Last appended: 3.42, Last appended by leader: 42, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:11.964993 11977 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 3 FOLLOWER]: Advancing to term 4
I20260618 20:07:12.044466 11882 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 4 FOLLOWER]: Advancing to term 5
I20260618 20:07:12.045295 11882 raft_consensus.cc:1275] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 5 FOLLOWER]: Refusing update from remote peer 7943481f339048bc9fc0a13855b76d2d: Log matching property violated. Preceding OpId in replica: term: 3 index: 42. Preceding OpId from leader: term: 5 index: 43. (index mismatch)
I20260618 20:07:12.045697 11939 consensus_queue.cc:1048] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 43, Last known committed idx: 42, Time since last communication: 0.000s
I20260618 20:07:12.046320 11731 raft_consensus.cc:1275] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 5 FOLLOWER]: Refusing update from remote peer 7943481f339048bc9fc0a13855b76d2d: Log matching property violated. Preceding OpId in replica: term: 3 index: 42. Preceding OpId from leader: term: 5 index: 43. (index mismatch)
I20260618 20:07:12.046554 11939 consensus_queue.cc:1048] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 43, Last known committed idx: 42, Time since last communication: 0.000s
I20260618 20:07:12.235774 11932 raft_consensus.cc:493] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7943481f339048bc9fc0a13855b76d2d)
I20260618 20:07:12.235903 11932 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 5 FOLLOWER]: Advancing to term 6
I20260618 20:07:12.236704 11932 raft_consensus.cc:515] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:12.236860 11932 leader_election.cc:290] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [CANDIDATE]: Term 6 election: Requested vote from peers 93bd9ee65f5041a78ccd58d7e335605d (127.11.83.67:43463), 7943481f339048bc9fc0a13855b76d2d (127.11.83.66:44039)
I20260618 20:07:12.237159 11882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "55ab28c109574af3998578604ff7aac1" candidate_term: 6 candidate_status { last_received { term: 5 index: 43 } } ignore_live_leader: false dest_uuid: "93bd9ee65f5041a78ccd58d7e335605d"
I20260618 20:07:12.237190 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "55ab28c109574af3998578604ff7aac1" candidate_term: 6 candidate_status { last_received { term: 5 index: 43 } } ignore_live_leader: false dest_uuid: "7943481f339048bc9fc0a13855b76d2d"
I20260618 20:07:12.237505 11696 leader_election.cc:304] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55ab28c109574af3998578604ff7aac1; no voters: 7943481f339048bc9fc0a13855b76d2d, 93bd9ee65f5041a78ccd58d7e335605d
I20260618 20:07:12.237614 11932 raft_consensus.cc:2749] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260618 20:07:12.259969 11731 raft_consensus.cc:1240] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 6 FOLLOWER]: Rejecting Update request from peer 7943481f339048bc9fc0a13855b76d2d for earlier term 5. Current term is 6. Ops: []
I20260618 20:07:12.260466 11978 consensus_queue.cc:1059] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 }, Status: INVALID_TERM, Last received: 5.43, Next index: 44, Last known committed idx: 43, Time since last communication: 0.000s
I20260618 20:07:12.312745 11978 raft_consensus.cc:3055] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 5 LEADER]: Stepping down as leader of term 5
I20260618 20:07:12.312912 11978 raft_consensus.cc:740] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7943481f339048bc9fc0a13855b76d2d, State: Running, Role: LEADER
I20260618 20:07:12.313031 11978 consensus_queue.cc:260] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 43, Committed index: 43, Last appended: 5.43, Last appended by leader: 43, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:12.313246 11978 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 5 FOLLOWER]: Advancing to term 6
I20260618 20:07:12.355345 11932 raft_consensus.cc:493] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 20:07:12.355474 11932 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 6 FOLLOWER]: Advancing to term 7
I20260618 20:07:12.356292 11932 raft_consensus.cc:515] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:12.356503 11932 leader_election.cc:290] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [CANDIDATE]: Term 7 election: Requested vote from peers 93bd9ee65f5041a78ccd58d7e335605d (127.11.83.67:43463), 7943481f339048bc9fc0a13855b76d2d (127.11.83.66:44039)
I20260618 20:07:12.356876 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "55ab28c109574af3998578604ff7aac1" candidate_term: 7 candidate_status { last_received { term: 5 index: 43 } } ignore_live_leader: false dest_uuid: "7943481f339048bc9fc0a13855b76d2d"
I20260618 20:07:12.356876 11882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "55ab28c109574af3998578604ff7aac1" candidate_term: 7 candidate_status { last_received { term: 5 index: 43 } } ignore_live_leader: false dest_uuid: "93bd9ee65f5041a78ccd58d7e335605d"
I20260618 20:07:12.357008 11807 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 6 FOLLOWER]: Advancing to term 7
I20260618 20:07:12.357867 11807 raft_consensus.cc:2468] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55ab28c109574af3998578604ff7aac1 in term 7.
I20260618 20:07:12.358166 11696 leader_election.cc:304] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55ab28c109574af3998578604ff7aac1, 7943481f339048bc9fc0a13855b76d2d; no voters: 93bd9ee65f5041a78ccd58d7e335605d
I20260618 20:07:12.358285 11932 raft_consensus.cc:2804] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 7 FOLLOWER]: Leader election won for term 7
I20260618 20:07:12.358443 11932 raft_consensus.cc:697] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 7 LEADER]: Becoming Leader. State: Replica: 55ab28c109574af3998578604ff7aac1, State: Running, Role: LEADER
I20260618 20:07:12.358616 11932 consensus_queue.cc:237] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 43, Committed index: 43, Last appended: 5.43, Last appended by leader: 43, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:12.359222 11625 catalog_manager.cc:5696] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 reported cstate change: term changed from 5 to 7, leader changed from 7943481f339048bc9fc0a13855b76d2d (127.11.83.66) to 55ab28c109574af3998578604ff7aac1 (127.11.83.65). New cstate: current_term: 7 leader_uuid: "55ab28c109574af3998578604ff7aac1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } health_report { overall_health: HEALTHY } } }
I20260618 20:07:12.414288 11977 raft_consensus.cc:493] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7943481f339048bc9fc0a13855b76d2d)
I20260618 20:07:12.414397 11977 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 5 FOLLOWER]: Advancing to term 6
I20260618 20:07:12.415268 11977 raft_consensus.cc:515] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:12.415485 11977 leader_election.cc:290] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [CANDIDATE]: Term 6 election: Requested vote from peers 7943481f339048bc9fc0a13855b76d2d (127.11.83.66:44039), 55ab28c109574af3998578604ff7aac1 (127.11.83.65:38817)
I20260618 20:07:12.415704 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "93bd9ee65f5041a78ccd58d7e335605d" candidate_term: 6 candidate_status { last_received { term: 5 index: 43 } } ignore_live_leader: false dest_uuid: "7943481f339048bc9fc0a13855b76d2d"
I20260618 20:07:12.415813 11807 raft_consensus.cc:2368] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 93bd9ee65f5041a78ccd58d7e335605d for earlier term 6. Current term is 7.
I20260618 20:07:12.415867 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "93bd9ee65f5041a78ccd58d7e335605d" candidate_term: 6 candidate_status { last_received { term: 5 index: 43 } } ignore_live_leader: false dest_uuid: "55ab28c109574af3998578604ff7aac1"
I20260618 20:07:12.416024 11847 leader_election.cc:400] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [CANDIDATE]: Term 6 election: Vote denied by peer 7943481f339048bc9fc0a13855b76d2d (127.11.83.66:44039) with higher term. Message: Invalid argument: T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 93bd9ee65f5041a78ccd58d7e335605d for earlier term 6. Current term is 7.
I20260618 20:07:12.416083 11847 leader_election.cc:403] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260618 20:07:12.416152 11977 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 6 FOLLOWER]: Advancing to term 7
I20260618 20:07:12.416764 11977 raft_consensus.cc:2749] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 7943481f339048bc9fc0a13855b76d2d (127.11.83.66:44039) with higher term. Message: Invalid argument: T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 93bd9ee65f5041a78ccd58d7e335605d for earlier term 6. Current term is 7.
I20260618 20:07:12.435676 11882 raft_consensus.cc:1275] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 7 FOLLOWER]: Refusing update from remote peer 55ab28c109574af3998578604ff7aac1: Log matching property violated. Preceding OpId in replica: term: 5 index: 43. Preceding OpId from leader: term: 7 index: 44. (index mismatch)
I20260618 20:07:12.436071 11932 consensus_queue.cc:1048] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 44, Last known committed idx: 43, Time since last communication: 0.000s
I20260618 20:07:12.476994 11807 raft_consensus.cc:1275] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 7 FOLLOWER]: Refusing update from remote peer 55ab28c109574af3998578604ff7aac1: Log matching property violated. Preceding OpId in replica: term: 5 index: 43. Preceding OpId from leader: term: 7 index: 44. (index mismatch)
I20260618 20:07:12.477330 11932 consensus_queue.cc:1048] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 44, Last known committed idx: 43, Time since last communication: 0.000s
I20260618 20:07:12.538532 11977 raft_consensus.cc:493] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 55ab28c109574af3998578604ff7aac1)
I20260618 20:07:12.538695 11977 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 7 FOLLOWER]: Advancing to term 8
I20260618 20:07:12.539404 11977 raft_consensus.cc:515] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:12.539655 11977 leader_election.cc:290] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [CANDIDATE]: Term 8 election: Requested vote from peers 7943481f339048bc9fc0a13855b76d2d (127.11.83.66:44039), 55ab28c109574af3998578604ff7aac1 (127.11.83.65:38817)
I20260618 20:07:12.539886 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "93bd9ee65f5041a78ccd58d7e335605d" candidate_term: 8 candidate_status { last_received { term: 7 index: 44 } } ignore_live_leader: false dest_uuid: "55ab28c109574af3998578604ff7aac1"
I20260618 20:07:12.539886 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "93bd9ee65f5041a78ccd58d7e335605d" candidate_term: 8 candidate_status { last_received { term: 7 index: 44 } } ignore_live_leader: false dest_uuid: "7943481f339048bc9fc0a13855b76d2d"
I20260618 20:07:12.540201 11847 leader_election.cc:304] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93bd9ee65f5041a78ccd58d7e335605d; no voters: 55ab28c109574af3998578604ff7aac1, 7943481f339048bc9fc0a13855b76d2d
I20260618 20:07:12.540277 11977 raft_consensus.cc:2749] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260618 20:07:12.544927 11882 raft_consensus.cc:1240] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 8 FOLLOWER]: Rejecting Update request from peer 55ab28c109574af3998578604ff7aac1 for earlier term 7. Current term is 8. Ops: []
I20260618 20:07:12.545208 11980 consensus_queue.cc:1059] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 }, Status: INVALID_TERM, Last received: 7.44, Next index: 45, Last known committed idx: 44, Time since last communication: 0.000s
I20260618 20:07:12.630119 11882 raft_consensus.cc:1240] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 8 FOLLOWER]: Rejecting Update request from peer 55ab28c109574af3998578604ff7aac1 for earlier term 7. Current term is 8. Ops: []
I20260618 20:07:12.630436 11932 consensus_queue.cc:1059] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 }, Status: INVALID_TERM, Last received: 7.44, Next index: 45, Last known committed idx: 44, Time since last communication: 0.000s
I20260618 20:07:12.660178 11978 raft_consensus.cc:493] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 55ab28c109574af3998578604ff7aac1)
I20260618 20:07:12.660286 11978 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 7 FOLLOWER]: Advancing to term 8
I20260618 20:07:12.660624 11977 raft_consensus.cc:493] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 20:07:12.660718 11977 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 8 FOLLOWER]: Advancing to term 9
I20260618 20:07:12.661077 11978 raft_consensus.cc:515] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:12.661394 11978 leader_election.cc:290] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [CANDIDATE]: Term 8 election: Requested vote from peers 93bd9ee65f5041a78ccd58d7e335605d (127.11.83.67:43463), 55ab28c109574af3998578604ff7aac1 (127.11.83.65:38817)
I20260618 20:07:12.661473 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "7943481f339048bc9fc0a13855b76d2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 44 } } ignore_live_leader: false dest_uuid: "55ab28c109574af3998578604ff7aac1"
I20260618 20:07:12.661481 11882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "7943481f339048bc9fc0a13855b76d2d" candidate_term: 8 candidate_status { last_received { term: 7 index: 44 } } ignore_live_leader: false dest_uuid: "93bd9ee65f5041a78ccd58d7e335605d"
I20260618 20:07:12.661695 11977 raft_consensus.cc:515] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:12.661784 11882 raft_consensus.cc:2368] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7943481f339048bc9fc0a13855b76d2d for earlier term 8. Current term is 9.
I20260618 20:07:12.661836 11977 leader_election.cc:290] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [CANDIDATE]: Term 9 election: Requested vote from peers 7943481f339048bc9fc0a13855b76d2d (127.11.83.66:44039), 55ab28c109574af3998578604ff7aac1 (127.11.83.65:38817)
I20260618 20:07:12.661945 11772 leader_election.cc:400] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [CANDIDATE]: Term 8 election: Vote denied by peer 93bd9ee65f5041a78ccd58d7e335605d (127.11.83.67:43463) with higher term. Message: Invalid argument: T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7943481f339048bc9fc0a13855b76d2d for earlier term 8. Current term is 9.
I20260618 20:07:12.661996 11772 leader_election.cc:403] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260618 20:07:12.662051 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "93bd9ee65f5041a78ccd58d7e335605d" candidate_term: 9 candidate_status { last_received { term: 7 index: 44 } } ignore_live_leader: false dest_uuid: "55ab28c109574af3998578604ff7aac1"
I20260618 20:07:12.661981 11807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "93bd9ee65f5041a78ccd58d7e335605d" candidate_term: 9 candidate_status { last_received { term: 7 index: 44 } } ignore_live_leader: false dest_uuid: "7943481f339048bc9fc0a13855b76d2d"
I20260618 20:07:12.662132 11978 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 8 FOLLOWER]: Advancing to term 9
I20260618 20:07:12.662745 11978 raft_consensus.cc:2749] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 93bd9ee65f5041a78ccd58d7e335605d (127.11.83.67:43463) with higher term. Message: Invalid argument: T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7943481f339048bc9fc0a13855b76d2d for earlier term 8. Current term is 9.
I20260618 20:07:12.663357 11807 raft_consensus.cc:2468] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93bd9ee65f5041a78ccd58d7e335605d in term 9.
I20260618 20:07:12.663513 11806 raft_consensus.cc:1240] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 9 FOLLOWER]: Rejecting Update request from peer 55ab28c109574af3998578604ff7aac1 for earlier term 7. Current term is 9. Ops: []
I20260618 20:07:12.663573 11847 leader_election.cc:304] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7943481f339048bc9fc0a13855b76d2d, 93bd9ee65f5041a78ccd58d7e335605d; no voters: 55ab28c109574af3998578604ff7aac1
I20260618 20:07:12.663689 11977 raft_consensus.cc:2804] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 9 FOLLOWER]: Leader election won for term 9
I20260618 20:07:12.663823 11977 raft_consensus.cc:697] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 9 LEADER]: Becoming Leader. State: Replica: 93bd9ee65f5041a78ccd58d7e335605d, State: Running, Role: LEADER
I20260618 20:07:12.663877 11977 consensus_queue.cc:237] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 44, Committed index: 44, Last appended: 7.44, Last appended by leader: 44, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:12.664052 11932 consensus_queue.cc:1059] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 }, Status: INVALID_TERM, Last received: 7.44, Next index: 45, Last known committed idx: 44, Time since last communication: 0.000s
I20260618 20:07:12.664347 11625 catalog_manager.cc:5696] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d reported cstate change: term changed from 7 to 9, leader changed from 55ab28c109574af3998578604ff7aac1 (127.11.83.65) to 93bd9ee65f5041a78ccd58d7e335605d (127.11.83.67). New cstate: current_term: 9 leader_uuid: "93bd9ee65f5041a78ccd58d7e335605d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } health_report { overall_health: UNKNOWN } } }
I20260618 20:07:12.735087 11979 raft_consensus.cc:3055] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 7 LEADER]: Stepping down as leader of term 7
I20260618 20:07:12.735193 11979 raft_consensus.cc:740] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 55ab28c109574af3998578604ff7aac1, State: Running, Role: LEADER
I20260618 20:07:12.735270 11979 consensus_queue.cc:260] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 44, Committed index: 44, Last appended: 7.44, Last appended by leader: 44, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:12.735376 11979 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 7 FOLLOWER]: Advancing to term 8
I20260618 20:07:12.756417 11731 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 8 FOLLOWER]: Advancing to term 9
I20260618 20:07:12.756808 11806 raft_consensus.cc:1275] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 9 FOLLOWER]: Refusing update from remote peer 93bd9ee65f5041a78ccd58d7e335605d: Log matching property violated. Preceding OpId in replica: term: 7 index: 44. Preceding OpId from leader: term: 9 index: 45. (index mismatch)
I20260618 20:07:12.757092 11977 consensus_queue.cc:1048] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 45, Last known committed idx: 44, Time since last communication: 0.000s
I20260618 20:07:12.757421 11731 raft_consensus.cc:1275] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 9 FOLLOWER]: Refusing update from remote peer 93bd9ee65f5041a78ccd58d7e335605d: Log matching property violated. Preceding OpId in replica: term: 7 index: 44. Preceding OpId from leader: term: 9 index: 45. (index mismatch)
I20260618 20:07:12.757675 11977 consensus_queue.cc:1048] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [LEADER]: Connected to new peer: Peer: permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 45, Last known committed idx: 44, Time since last communication: 0.000s
I20260618 20:07:12.858567 11978 raft_consensus.cc:493] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 93bd9ee65f5041a78ccd58d7e335605d)
I20260618 20:07:12.858676 11978 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 9 FOLLOWER]: Advancing to term 10
I20260618 20:07:12.859472 11978 raft_consensus.cc:515] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:12.859658 11978 leader_election.cc:290] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [CANDIDATE]: Term 10 election: Requested vote from peers 93bd9ee65f5041a78ccd58d7e335605d (127.11.83.67:43463), 55ab28c109574af3998578604ff7aac1 (127.11.83.65:38817)
I20260618 20:07:12.859917 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "7943481f339048bc9fc0a13855b76d2d" candidate_term: 10 candidate_status { last_received { term: 9 index: 45 } } ignore_live_leader: false dest_uuid: "55ab28c109574af3998578604ff7aac1"
I20260618 20:07:12.859918 11882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "7943481f339048bc9fc0a13855b76d2d" candidate_term: 10 candidate_status { last_received { term: 9 index: 45 } } ignore_live_leader: false dest_uuid: "93bd9ee65f5041a78ccd58d7e335605d"
I20260618 20:07:12.860036 11731 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 9 FOLLOWER]: Advancing to term 10
I20260618 20:07:12.860664 11731 raft_consensus.cc:2468] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7943481f339048bc9fc0a13855b76d2d in term 10.
I20260618 20:07:12.860915 11771 leader_election.cc:304] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55ab28c109574af3998578604ff7aac1, 7943481f339048bc9fc0a13855b76d2d; no voters: 93bd9ee65f5041a78ccd58d7e335605d
I20260618 20:07:12.861037 11978 raft_consensus.cc:2804] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 10 FOLLOWER]: Leader election won for term 10
I20260618 20:07:12.861232 11978 raft_consensus.cc:697] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 10 LEADER]: Becoming Leader. State: Replica: 7943481f339048bc9fc0a13855b76d2d, State: Running, Role: LEADER
I20260618 20:07:12.861306 11978 consensus_queue.cc:237] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 45, Committed index: 45, Last appended: 9.45, Last appended by leader: 45, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:12.861984 11625 catalog_manager.cc:5696] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d reported cstate change: term changed from 9 to 10, leader changed from 93bd9ee65f5041a78ccd58d7e335605d (127.11.83.67) to 7943481f339048bc9fc0a13855b76d2d (127.11.83.66). New cstate: current_term: 10 leader_uuid: "7943481f339048bc9fc0a13855b76d2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } health_report { overall_health: UNKNOWN } } }
I20260618 20:07:12.864604 11806 raft_consensus.cc:1240] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 10 LEADER]: Rejecting Update request from peer 93bd9ee65f5041a78ccd58d7e335605d for earlier term 9. Current term is 10. Ops: []
I20260618 20:07:12.864960 11981 consensus_queue.cc:1059] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 }, Status: INVALID_TERM, Last received: 9.45, Next index: 46, Last known committed idx: 45, Time since last communication: 0.000s
I20260618 20:07:12.865052 11981 consensus_queue.cc:1243] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [LEADER]: Peer 7943481f339048bc9fc0a13855b76d2d log is divergent from this leader: its last log entry 10.46 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 45
I20260618 20:07:12.880702 11731 raft_consensus.cc:1240] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 10 FOLLOWER]: Rejecting Update request from peer 93bd9ee65f5041a78ccd58d7e335605d for earlier term 9. Current term is 10. Ops: []
I20260618 20:07:12.881084 11977 consensus_queue.cc:1059] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 }, Status: INVALID_TERM, Last received: 9.45, Next index: 46, Last known committed idx: 45, Time since last communication: 0.000s
I20260618 20:07:12.953212 11981 raft_consensus.cc:3055] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 9 LEADER]: Stepping down as leader of term 9
I20260618 20:07:12.953333 11981 raft_consensus.cc:740] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 93bd9ee65f5041a78ccd58d7e335605d, State: Running, Role: LEADER
I20260618 20:07:12.953419 11981 consensus_queue.cc:260] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 45, Committed index: 45, Last appended: 9.45, Last appended by leader: 45, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:12.953915 11981 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 9 FOLLOWER]: Advancing to term 10
I20260618 20:07:12.975914 11731 raft_consensus.cc:1275] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 10 FOLLOWER]: Refusing update from remote peer 7943481f339048bc9fc0a13855b76d2d: Log matching property violated. Preceding OpId in replica: term: 9 index: 45. Preceding OpId from leader: term: 10 index: 46. (index mismatch)
I20260618 20:07:12.976276 11978 consensus_queue.cc:1048] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 46, Last known committed idx: 45, Time since last communication: 0.000s
I20260618 20:07:12.979315 11882 raft_consensus.cc:1275] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 10 FOLLOWER]: Refusing update from remote peer 7943481f339048bc9fc0a13855b76d2d: Log matching property violated. Preceding OpId in replica: term: 9 index: 45. Preceding OpId from leader: term: 10 index: 46. (index mismatch)
I20260618 20:07:12.979593 11978 consensus_queue.cc:1048] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 46, Last known committed idx: 45, Time since last communication: 0.000s
I20260618 20:07:13.354898 11979 raft_consensus.cc:493] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7943481f339048bc9fc0a13855b76d2d)
I20260618 20:07:13.355007 11979 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 10 FOLLOWER]: Advancing to term 11
I20260618 20:07:13.355890 11979 raft_consensus.cc:515] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:13.356215 11979 leader_election.cc:290] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [CANDIDATE]: Term 11 election: Requested vote from peers 93bd9ee65f5041a78ccd58d7e335605d (127.11.83.67:43463), 7943481f339048bc9fc0a13855b76d2d (127.11.83.66:44039)
I20260618 20:07:13.356424 11597 timestamp_advancement-itest.cc:267] GCing logs...
I20260618 20:07:13.356500 11882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "55ab28c109574af3998578604ff7aac1" candidate_term: 11 candidate_status { last_received { term: 10 index: 46 } } ignore_live_leader: false dest_uuid: "93bd9ee65f5041a78ccd58d7e335605d"
I20260618 20:07:13.356500 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "55ab28c109574af3998578604ff7aac1" candidate_term: 11 candidate_status { last_received { term: 10 index: 46 } } ignore_live_leader: false dest_uuid: "7943481f339048bc9fc0a13855b76d2d"
I20260618 20:07:13.356674 11597 log_reader.cc:385] T adf27860270e4db1ae9ee6f46ea997fe: removed 1 log segments from log reader
I20260618 20:07:13.356720 11597 log.cc:1079] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1: Deleting log segment in path: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781813230966404-11597-0/minicluster-data/ts-0-root/wals/adf27860270e4db1ae9ee6f46ea997fe/wal-000000001 (ops 1-41)
I20260618 20:07:13.356765 11696 leader_election.cc:304] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55ab28c109574af3998578604ff7aac1; no voters: 7943481f339048bc9fc0a13855b76d2d, 93bd9ee65f5041a78ccd58d7e335605d
I20260618 20:07:13.356904 11979 raft_consensus.cc:2749] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260618 20:07:13.357201 11597 timestamp_advancement-itest.cc:274] Shutting down cluster...
I20260618 20:07:13.357301 11597 master.cc:562] Master@127.11.83.126:41309 shutting down...
I20260618 20:07:13.377398 11731 raft_consensus.cc:1240] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 11 FOLLOWER]: Rejecting Update request from peer 7943481f339048bc9fc0a13855b76d2d for earlier term 10. Current term is 11. Ops: []
I20260618 20:07:13.377741 11984 consensus_queue.cc:1059] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 }, Status: INVALID_TERM, Last received: 10.46, Next index: 47, Last known committed idx: 46, Time since last communication: 0.000s
I20260618 20:07:13.377877 11984 raft_consensus.cc:3055] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 10 LEADER]: Stepping down as leader of term 10
I20260618 20:07:13.377898 11984 raft_consensus.cc:740] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7943481f339048bc9fc0a13855b76d2d, State: Running, Role: LEADER
I20260618 20:07:13.377988 11984 consensus_queue.cc:260] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 46, Committed index: 46, Last appended: 10.46, Last appended by leader: 46, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:13.378106 11984 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 10 FOLLOWER]: Advancing to term 11
I20260618 20:07:13.428700 11981 raft_consensus.cc:493] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7943481f339048bc9fc0a13855b76d2d)
I20260618 20:07:13.428823 11981 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 10 FOLLOWER]: Advancing to term 11
I20260618 20:07:13.429718 11981 raft_consensus.cc:515] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:13.429955 11981 leader_election.cc:290] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [CANDIDATE]: Term 11 election: Requested vote from peers 7943481f339048bc9fc0a13855b76d2d (127.11.83.66:44039), 55ab28c109574af3998578604ff7aac1 (127.11.83.65:38817)
I20260618 20:07:13.430300 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "93bd9ee65f5041a78ccd58d7e335605d" candidate_term: 11 candidate_status { last_received { term: 10 index: 46 } } ignore_live_leader: false dest_uuid: "7943481f339048bc9fc0a13855b76d2d"
I20260618 20:07:13.430300 11731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "93bd9ee65f5041a78ccd58d7e335605d" candidate_term: 11 candidate_status { last_received { term: 10 index: 46 } } ignore_live_leader: false dest_uuid: "55ab28c109574af3998578604ff7aac1"
I20260618 20:07:13.430423 11731 raft_consensus.cc:2393] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 93bd9ee65f5041a78ccd58d7e335605d in current term 11: Already voted for candidate 55ab28c109574af3998578604ff7aac1 in this term.
I20260618 20:07:13.431398 11806 raft_consensus.cc:2468] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93bd9ee65f5041a78ccd58d7e335605d in term 11.
I20260618 20:07:13.431631 11847 leader_election.cc:304] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7943481f339048bc9fc0a13855b76d2d, 93bd9ee65f5041a78ccd58d7e335605d; no voters: 55ab28c109574af3998578604ff7aac1
I20260618 20:07:13.431727 11981 raft_consensus.cc:2804] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 11 FOLLOWER]: Leader election won for term 11
I20260618 20:07:13.431808 11981 raft_consensus.cc:697] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 11 LEADER]: Becoming Leader. State: Replica: 93bd9ee65f5041a78ccd58d7e335605d, State: Running, Role: LEADER
I20260618 20:07:13.431859 11981 consensus_queue.cc:237] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 46, Committed index: 46, Last appended: 10.46, Last appended by leader: 46, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
W20260618 20:07:13.434823 11908 heartbeater.cc:646] Failed to heartbeat to 127.11.83.126:41309 (0 consecutive failures): Remote error: Failed to send heartbeat to master: Service unavailable: service kudu.master.MasterService not registered on Master
I20260618 20:07:13.471026 11979 raft_consensus.cc:493] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 20:07:13.471140 11979 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 11 FOLLOWER]: Advancing to term 12
I20260618 20:07:13.471949 11979 raft_consensus.cc:515] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:13.472138 11979 leader_election.cc:290] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [CANDIDATE]: Term 12 election: Requested vote from peers 93bd9ee65f5041a78ccd58d7e335605d (127.11.83.67:43463), 7943481f339048bc9fc0a13855b76d2d (127.11.83.66:44039)
I20260618 20:07:13.472457 11882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "55ab28c109574af3998578604ff7aac1" candidate_term: 12 candidate_status { last_received { term: 10 index: 46 } } ignore_live_leader: false dest_uuid: "93bd9ee65f5041a78ccd58d7e335605d"
I20260618 20:07:13.472471 11806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "55ab28c109574af3998578604ff7aac1" candidate_term: 12 candidate_status { last_received { term: 10 index: 46 } } ignore_live_leader: false dest_uuid: "7943481f339048bc9fc0a13855b76d2d"
I20260618 20:07:13.472602 11806 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 11 FOLLOWER]: Advancing to term 12
I20260618 20:07:13.473241 11806 raft_consensus.cc:2468] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55ab28c109574af3998578604ff7aac1 in term 12.
I20260618 20:07:13.473464 11696 leader_election.cc:304] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 55ab28c109574af3998578604ff7aac1, 7943481f339048bc9fc0a13855b76d2d; no voters: 93bd9ee65f5041a78ccd58d7e335605d
I20260618 20:07:13.473573 11979 raft_consensus.cc:2804] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 12 FOLLOWER]: Leader election won for term 12
I20260618 20:07:13.473690 11979 raft_consensus.cc:697] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 12 LEADER]: Becoming Leader. State: Replica: 55ab28c109574af3998578604ff7aac1, State: Running, Role: LEADER
I20260618 20:07:13.473742 11979 consensus_queue.cc:237] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 46, Committed index: 46, Last appended: 10.46, Last appended by leader: 46, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:13.498070 11597 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9d582095dd02434da9539f9de37c442d [term 1 LEADER]: Raft consensus shutting down.
I20260618 20:07:13.498203 11597 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9d582095dd02434da9539f9de37c442d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 20:07:13.498232 11597 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9d582095dd02434da9539f9de37c442d: stopping tablet replica
I20260618 20:07:13.510944 11597 master.cc:584] Master@127.11.83.126:41309 shutdown complete.
I20260618 20:07:13.512845 11597 tablet_server.cc:179] TabletServer@127.11.83.65:0 shutting down...
W20260618 20:07:13.518196 11846 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260618 20:07:13.518682 11846 consensus_peers.cc:597] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d -> Peer 55ab28c109574af3998578604ff7aac1 (127.11.83.65:38817): Couldn't send request to peer 55ab28c109574af3998578604ff7aac1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260618 20:07:13.530279 11806 raft_consensus.cc:1240] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 12 FOLLOWER]: Rejecting Update request from peer 93bd9ee65f5041a78ccd58d7e335605d for earlier term 11. Current term is 12. Ops: []
I20260618 20:07:13.530714 11977 consensus_queue.cc:1059] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 }, Status: INVALID_TERM, Last received: 0.0, Next index: 47, Last known committed idx: 46, Time since last communication: 0.000s
I20260618 20:07:13.530838 11977 raft_consensus.cc:3055] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 11 LEADER]: Stepping down as leader of term 11
I20260618 20:07:13.530856 11977 raft_consensus.cc:740] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 93bd9ee65f5041a78ccd58d7e335605d, State: Running, Role: LEADER
I20260618 20:07:13.530936 11977 consensus_queue.cc:260] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 46, Committed index: 46, Last appended: 11.47, Last appended by leader: 47, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:13.531008 11977 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 11 FOLLOWER]: Advancing to term 12
I20260618 20:07:13.569283 11597 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260618 20:07:13.569494 11597 tablet_replica.cc:333] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1: stopping tablet replica
I20260618 20:07:13.569558 11597 raft_consensus.cc:2243] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 12 LEADER]: Raft consensus shutting down.
I20260618 20:07:13.569662 11597 pending_rounds.cc:70] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1: Trying to abort 1 pending ops.
I20260618 20:07:13.569739 11597 pending_rounds.cc:77] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1: Aborting op as it isn't in flight: id { term: 12 index: 47 } timestamp: 7298307004309057536 op_type: NO_OP noop_request { }
I20260618 20:07:13.569818 11597 raft_consensus.cc:2889] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 12 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260618 20:07:13.569871 11597 raft_consensus.cc:2272] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260618 20:07:13.582259 11597 tablet_server.cc:196] TabletServer@127.11.83.65:0 shutdown complete.
I20260618 20:07:13.583365 11597 tablet_server.cc:179] TabletServer@127.11.83.66:0 shutting down...
I20260618 20:07:13.618721 11984 raft_consensus.cc:493] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 20:07:13.618834 11984 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 12 FOLLOWER]: Advancing to term 13
I20260618 20:07:13.619643 11984 raft_consensus.cc:515] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:13.619899 11984 leader_election.cc:290] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [CANDIDATE]: Term 13 election: Requested vote from peers 93bd9ee65f5041a78ccd58d7e335605d (127.11.83.67:43463), 55ab28c109574af3998578604ff7aac1 (127.11.83.65:38817)
I20260618 20:07:13.620385 11882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "7943481f339048bc9fc0a13855b76d2d" candidate_term: 13 candidate_status { last_received { term: 10 index: 46 } } ignore_live_leader: false dest_uuid: "93bd9ee65f5041a78ccd58d7e335605d"
I20260618 20:07:13.620493 11882 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 12 FOLLOWER]: Advancing to term 13
W20260618 20:07:13.620872 11771 leader_election.cc:336] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 55ab28c109574af3998578604ff7aac1 (127.11.83.65:38817): Network error: Client connection negotiation failed: client connection to 127.11.83.65:38817: connect: Connection refused (error 111)
I20260618 20:07:13.621263 11882 raft_consensus.cc:2410] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7943481f339048bc9fc0a13855b76d2d for term 13 because replica has last-logged OpId of term: 11 index: 47, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 46.
I20260618 20:07:13.621457 11772 leader_election.cc:304] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7943481f339048bc9fc0a13855b76d2d; no voters: 55ab28c109574af3998578604ff7aac1, 93bd9ee65f5041a78ccd58d7e335605d
I20260618 20:07:13.621590 11984 raft_consensus.cc:2749] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260618 20:07:13.755131 11984 raft_consensus.cc:493] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 20:07:13.755256 11984 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 13 FOLLOWER]: Advancing to term 14
I20260618 20:07:13.755997 11984 raft_consensus.cc:515] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:13.756224 11984 leader_election.cc:290] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [CANDIDATE]: Term 14 election: Requested vote from peers 93bd9ee65f5041a78ccd58d7e335605d (127.11.83.67:43463), 55ab28c109574af3998578604ff7aac1 (127.11.83.65:38817)
I20260618 20:07:13.756464 11882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adf27860270e4db1ae9ee6f46ea997fe" candidate_uuid: "7943481f339048bc9fc0a13855b76d2d" candidate_term: 14 candidate_status { last_received { term: 10 index: 46 } } ignore_live_leader: false dest_uuid: "93bd9ee65f5041a78ccd58d7e335605d"
I20260618 20:07:13.756567 11882 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 13 FOLLOWER]: Advancing to term 14
W20260618 20:07:13.757009 11771 leader_election.cc:336] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 55ab28c109574af3998578604ff7aac1 (127.11.83.65:38817): Network error: Client connection negotiation failed: client connection to 127.11.83.65:38817: connect: Connection refused (error 111)
I20260618 20:07:13.757347 11882 raft_consensus.cc:2410] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7943481f339048bc9fc0a13855b76d2d for term 14 because replica has last-logged OpId of term: 11 index: 47, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 46.
I20260618 20:07:13.757566 11772 leader_election.cc:304] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7943481f339048bc9fc0a13855b76d2d; no voters: 55ab28c109574af3998578604ff7aac1, 93bd9ee65f5041a78ccd58d7e335605d
I20260618 20:07:13.757678 11984 raft_consensus.cc:2749] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260618 20:07:13.785818 11977 raft_consensus.cc:493] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 20:07:13.785933 11977 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 14 FOLLOWER]: Advancing to term 15
I20260618 20:07:13.786721 11977 raft_consensus.cc:515] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:13.786933 11977 leader_election.cc:290] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [CANDIDATE]: Term 15 election: Requested vote from peers 7943481f339048bc9fc0a13855b76d2d (127.11.83.66:44039), 55ab28c109574af3998578604ff7aac1 (127.11.83.65:38817)
W20260618 20:07:13.787506 11847 leader_election.cc:336] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 7943481f339048bc9fc0a13855b76d2d (127.11.83.66:44039): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260618 20:07:13.787720 11846 leader_election.cc:336] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 55ab28c109574af3998578604ff7aac1 (127.11.83.65:38817): Network error: Client connection negotiation failed: client connection to 127.11.83.65:38817: connect: Connection refused (error 111)
I20260618 20:07:13.787808 11846 leader_election.cc:304] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93bd9ee65f5041a78ccd58d7e335605d; no voters: 55ab28c109574af3998578604ff7aac1, 7943481f339048bc9fc0a13855b76d2d
I20260618 20:07:13.787925 11977 raft_consensus.cc:2749] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260618 20:07:13.836292 11597 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260618 20:07:13.836445 11597 tablet_replica.cc:333] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d: stopping tablet replica
I20260618 20:07:13.836501 11597 raft_consensus.cc:2243] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260618 20:07:13.836572 11597 raft_consensus.cc:2272] T adf27860270e4db1ae9ee6f46ea997fe P 7943481f339048bc9fc0a13855b76d2d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260618 20:07:13.848698 11597 tablet_server.cc:196] TabletServer@127.11.83.66:0 shutdown complete.
I20260618 20:07:13.849742 11597 tablet_server.cc:179] TabletServer@127.11.83.67:0 shutting down...
I20260618 20:07:13.864130 11597 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260618 20:07:13.864356 11597 tablet_replica.cc:333] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d: stopping tablet replica
I20260618 20:07:13.864430 11597 raft_consensus.cc:2243] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260618 20:07:13.864521 11597 pending_rounds.cc:70] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d: Trying to abort 1 pending ops.
I20260618 20:07:13.864562 11597 pending_rounds.cc:77] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d: Aborting op as it isn't in flight: id { term: 11 index: 47 } timestamp: 7298307004137607168 op_type: NO_OP noop_request { }
I20260618 20:07:13.864632 11597 raft_consensus.cc:2889] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260618 20:07:13.864678 11597 raft_consensus.cc:2272] T adf27860270e4db1ae9ee6f46ea997fe P 93bd9ee65f5041a78ccd58d7e335605d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260618 20:07:13.876780 11597 tablet_server.cc:196] TabletServer@127.11.83.67:0 shutdown complete.
I20260618 20:07:13.877589 11597 timestamp_advancement-itest.cc:282] Restarting single tablet server...
I20260618 20:07:13.877708 11597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260618 20:07:13.877786 11597 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
I20260618 20:07:13.879218 11597 server_base.cc:1061] running on GCE node
W20260618 20:07:13.879241 11993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:13.879217 11991 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:13.879280 11990 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 20:07:13.879613 11597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260618 20:07:13.879659 11597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260618 20:07:13.879673 11597 hybrid_clock.cc:648] HybridClock initialized: now 1781813233879673 us; error 0 us; skew 500 ppm
I20260618 20:07:13.880317 11597 webserver.cc:533] Webserver started at http://127.11.83.65:45369/ using document root <none> and password file <none>
I20260618 20:07:13.880422 11597 fs_manager.cc:362] Metadata directory not provided
I20260618 20:07:13.880461 11597 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260618 20:07:13.881181 11597 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260618 20:07:13.882748 12001 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:13.882910 11597 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 20:07:13.882979 11597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781813230966404-11597-0/minicluster-data/ts-0-root
uuid: "55ab28c109574af3998578604ff7aac1"
format_stamp: "Formatted at 2026-06-18 20:07:11 on dist-test-slave-szgn"
I20260618 20:07:13.883037 11597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781813230966404-11597-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781813230966404-11597-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781813230966404-11597-0/minicluster-data/ts-0-root/data
Total live blocks: 5
Total live bytes: 5792
Total live bytes (after alignment): 24576
Total number of LBM containers: 6 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 20:07:13.901775 11597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 20:07:13.902089 11597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 20:07:13.902284 11597 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260618 20:07:13.902611 12008 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260618 20:07:13.903368 11597 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260618 20:07:13.903447 11597 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20260618 20:07:13.903496 11597 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260618 20:07:13.903955 11597 ts_tablet_manager.cc:616] Registered 1 tablets
I20260618 20:07:13.904008 11597 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260618 20:07:13.904014 12008 tablet_bootstrap.cc:492] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1: Bootstrap starting.
I20260618 20:07:13.905742 12008 tablet_bootstrap.cc:492] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260618 20:07:13.906055 12008 tablet_bootstrap.cc:492] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1: Bootstrap complete.
I20260618 20:07:13.906164 12008 ts_tablet_manager.cc:1403] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260618 20:07:13.906322 12008 raft_consensus.cc:359] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 12 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:13.906437 12008 raft_consensus.cc:740] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 12 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55ab28c109574af3998578604ff7aac1, State: Initialized, Role: FOLLOWER
I20260618 20:07:13.906505 12008 consensus_queue.cc:260] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 46, Last appended: 12.47, Last appended by leader: 47, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:13.906685 12008 ts_tablet_manager.cc:1434] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260618 20:07:13.907717 11597 rpc_server.cc:307] RPC server started. Bound to: 127.11.83.65:38817
I20260618 20:07:13.910661 12067 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.83.65:38817 every 8 connection(s)
W20260618 20:07:13.911640 12068 heartbeater.cc:412] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260618 20:07:13.915287 11597 tablet.cc:2106] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1: Compaction resulted in no output rows (all input rows were GCed!) Removing all input rowsets.
I20260618 20:07:13.916420 11597 timestamp_advancement-itest.cc:274] Shutting down cluster...
I20260618 20:07:13.916491 11597 tablet_server.cc:179] TabletServer@127.11.83.65:38817 shutting down...
I20260618 20:07:13.982456 12049 raft_consensus.cc:493] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 20:07:13.982563 12049 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 12 FOLLOWER]: Advancing to term 13
I20260618 20:07:13.983296 12049 raft_consensus.cc:515] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:13.983528 12049 leader_election.cc:290] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [CANDIDATE]: Term 13 election: Requested vote from peers 93bd9ee65f5041a78ccd58d7e335605d (127.11.83.67:43463), 7943481f339048bc9fc0a13855b76d2d (127.11.83.66:44039)
W20260618 20:07:13.984653 12004 leader_election.cc:336] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 93bd9ee65f5041a78ccd58d7e335605d (127.11.83.67:43463): Network error: Client connection negotiation failed: client connection to 127.11.83.67:43463: connect: Connection refused (error 111)
W20260618 20:07:13.984752 12004 leader_election.cc:336] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 7943481f339048bc9fc0a13855b76d2d (127.11.83.66:44039): Network error: Client connection negotiation failed: client connection to 127.11.83.66:44039: connect: Connection refused (error 111)
I20260618 20:07:13.984790 12004 leader_election.cc:304] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55ab28c109574af3998578604ff7aac1; no voters: 7943481f339048bc9fc0a13855b76d2d, 93bd9ee65f5041a78ccd58d7e335605d
I20260618 20:07:13.984889 12049 raft_consensus.cc:2749] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260618 20:07:14.119618 12049 raft_consensus.cc:493] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 20:07:14.119721 12049 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 13 FOLLOWER]: Advancing to term 14
I20260618 20:07:14.120512 12049 raft_consensus.cc:515] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:14.120692 12049 leader_election.cc:290] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [CANDIDATE]: Term 14 election: Requested vote from peers 93bd9ee65f5041a78ccd58d7e335605d (127.11.83.67:43463), 7943481f339048bc9fc0a13855b76d2d (127.11.83.66:44039)
W20260618 20:07:14.121378 12004 leader_election.cc:336] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 93bd9ee65f5041a78ccd58d7e335605d (127.11.83.67:43463): Network error: Client connection negotiation failed: client connection to 127.11.83.67:43463: connect: Connection refused (error 111)
W20260618 20:07:14.121444 12004 leader_election.cc:336] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 7943481f339048bc9fc0a13855b76d2d (127.11.83.66:44039): Network error: Client connection negotiation failed: client connection to 127.11.83.66:44039: connect: Connection refused (error 111)
I20260618 20:07:14.121567 12004 leader_election.cc:304] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55ab28c109574af3998578604ff7aac1; no voters: 7943481f339048bc9fc0a13855b76d2d, 93bd9ee65f5041a78ccd58d7e335605d
I20260618 20:07:14.121683 12049 raft_consensus.cc:2749] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260618 20:07:14.161353 11597 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260618 20:07:14.161667 11597 tablet_replica.cc:333] stopping tablet replica
I20260618 20:07:14.161767 11597 raft_consensus.cc:2243] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260618 20:07:14.161830 11597 pending_rounds.cc:70] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1: Trying to abort 1 pending ops.
I20260618 20:07:14.161845 11597 pending_rounds.cc:77] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1: Aborting op as it isn't in flight: id { term: 12 index: 47 } timestamp: 7298307004309057536 op_type: NO_OP noop_request { }
I20260618 20:07:14.161892 11597 raft_consensus.cc:2889] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260618 20:07:14.161911 11597 raft_consensus.cc:2272] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260618 20:07:14.174225 11597 tablet_server.cc:196] TabletServer@127.11.83.65:38817 shutdown complete.
I20260618 20:07:14.175565 11597 timestamp_advancement-itest.cc:282] Restarting single tablet server...
I20260618 20:07:14.175720 11597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260618 20:07:14.175853 11597 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260618 20:07:14.177033 12078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:14.177459 12079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:14.177459 12081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 20:07:14.177596 11597 server_base.cc:1061] running on GCE node
I20260618 20:07:14.177793 11597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260618 20:07:14.177831 11597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260618 20:07:14.177884 11597 hybrid_clock.cc:648] HybridClock initialized: now 1781813234177883 us; error 0 us; skew 500 ppm
I20260618 20:07:14.178524 11597 webserver.cc:533] Webserver started at http://127.11.83.65:45369/ using document root <none> and password file <none>
I20260618 20:07:14.178627 11597 fs_manager.cc:362] Metadata directory not provided
I20260618 20:07:14.178666 11597 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260618 20:07:14.179347 11597 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260618 20:07:14.180720 12089 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:14.180845 11597 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260618 20:07:14.180917 11597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781813230966404-11597-0/minicluster-data/ts-0-root
uuid: "55ab28c109574af3998578604ff7aac1"
format_stamp: "Formatted at 2026-06-18 20:07:11 on dist-test-slave-szgn"
I20260618 20:07:14.180976 11597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781813230966404-11597-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781813230966404-11597-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781813230966404-11597-0/minicluster-data/ts-0-root/data
Total live blocks: 5
Total live bytes: 5792
Total live bytes (after alignment): 24576
Total number of LBM containers: 6 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 20:07:14.208774 11597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 20:07:14.209017 11597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 20:07:14.209208 11597 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260618 20:07:14.210171 11597 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260618 20:07:14.210232 11597 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20260618 20:07:14.210682 11597 ts_tablet_manager.cc:616] Registered 1 tablets
I20260618 20:07:14.210744 12096 tablet_bootstrap.cc:492] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1: Bootstrap starting.
I20260618 20:07:14.210736 11597 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:14.212265 12096 tablet_bootstrap.cc:492] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260618 20:07:14.212522 12096 tablet_bootstrap.cc:492] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1: Bootstrap complete.
I20260618 20:07:14.212637 12096 ts_tablet_manager.cc:1403] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260618 20:07:14.212795 12096 raft_consensus.cc:359] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 14 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:14.212888 12096 raft_consensus.cc:740] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 14 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55ab28c109574af3998578604ff7aac1, State: Initialized, Role: FOLLOWER
I20260618 20:07:14.212953 12096 consensus_queue.cc:260] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 46, Last appended: 12.47, Last appended by leader: 47, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:14.213136 12096 ts_tablet_manager.cc:1434] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260618 20:07:14.214464 11597 rpc_server.cc:307] RPC server started. Bound to: 127.11.83.65:38817
I20260618 20:07:14.215472 12155 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.83.65:38817 every 8 connection(s)
W20260618 20:07:14.216334 12156 heartbeater.cc:412] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260618 20:07:14.219347 11597 tablet.cc:2106] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1: Compaction resulted in no output rows (all input rows were GCed!) Removing all input rowsets.
/home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/integration-tests/timestamp_advancement-itest.cc:362: Failure
Value of: s.IsCorruption()
Actual: false
Expected: true
OK
I20260618 20:07:14.220566 11597 tablet_server.cc:179] TabletServer@127.11.83.65:38817 shutting down...
I20260618 20:07:14.319975 12135 raft_consensus.cc:493] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 20:07:14.320083 12135 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 14 FOLLOWER]: Advancing to term 15
I20260618 20:07:14.320930 12135 raft_consensus.cc:515] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:14.321169 12135 leader_election.cc:290] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [CANDIDATE]: Term 15 election: Requested vote from peers 93bd9ee65f5041a78ccd58d7e335605d (127.11.83.67:43463), 7943481f339048bc9fc0a13855b76d2d (127.11.83.66:44039)
W20260618 20:07:14.322176 12092 leader_election.cc:336] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 7943481f339048bc9fc0a13855b76d2d (127.11.83.66:44039): Network error: Client connection negotiation failed: client connection to 127.11.83.66:44039: connect: Connection refused (error 111)
W20260618 20:07:14.322249 12092 leader_election.cc:336] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 93bd9ee65f5041a78ccd58d7e335605d (127.11.83.67:43463): Network error: Client connection negotiation failed: client connection to 127.11.83.67:43463: connect: Connection refused (error 111)
I20260618 20:07:14.322265 12092 leader_election.cc:304] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55ab28c109574af3998578604ff7aac1; no voters: 7943481f339048bc9fc0a13855b76d2d, 93bd9ee65f5041a78ccd58d7e335605d
I20260618 20:07:14.322337 12135 raft_consensus.cc:2749] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260618 20:07:14.444023 12135 raft_consensus.cc:493] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 20:07:14.444137 12135 raft_consensus.cc:3060] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 15 FOLLOWER]: Advancing to term 16
I20260618 20:07:14.444880 12135 raft_consensus.cc:515] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93bd9ee65f5041a78ccd58d7e335605d" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 43463 } } peers { permanent_uuid: "7943481f339048bc9fc0a13855b76d2d" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 44039 } } peers { permanent_uuid: "55ab28c109574af3998578604ff7aac1" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 38817 } }
I20260618 20:07:14.445103 12135 leader_election.cc:290] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [CANDIDATE]: Term 16 election: Requested vote from peers 93bd9ee65f5041a78ccd58d7e335605d (127.11.83.67:43463), 7943481f339048bc9fc0a13855b76d2d (127.11.83.66:44039)
W20260618 20:07:14.445802 12092 leader_election.cc:336] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 93bd9ee65f5041a78ccd58d7e335605d (127.11.83.67:43463): Network error: Client connection negotiation failed: client connection to 127.11.83.67:43463: connect: Connection refused (error 111)
W20260618 20:07:14.445870 12092 leader_election.cc:336] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 7943481f339048bc9fc0a13855b76d2d (127.11.83.66:44039): Network error: Client connection negotiation failed: client connection to 127.11.83.66:44039: connect: Connection refused (error 111)
I20260618 20:07:14.445886 12092 leader_election.cc:304] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 55ab28c109574af3998578604ff7aac1; no voters: 7943481f339048bc9fc0a13855b76d2d, 93bd9ee65f5041a78ccd58d7e335605d
I20260618 20:07:14.445953 12135 raft_consensus.cc:2749] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260618 20:07:14.465939 11597 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260618 20:07:14.466231 11597 tablet_replica.cc:333] stopping tablet replica
I20260618 20:07:14.466324 11597 raft_consensus.cc:2243] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260618 20:07:14.466384 11597 pending_rounds.cc:70] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1: Trying to abort 1 pending ops.
I20260618 20:07:14.466408 11597 pending_rounds.cc:77] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1: Aborting op as it isn't in flight: id { term: 12 index: 47 } timestamp: 7298307004309057536 op_type: NO_OP noop_request { }
I20260618 20:07:14.466475 11597 raft_consensus.cc:2889] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260618 20:07:14.466507 11597 raft_consensus.cc:2272] T adf27860270e4db1ae9ee6f46ea997fe P 55ab28c109574af3998578604ff7aac1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260618 20:07:14.478785 11597 tablet_server.cc:196] TabletServer@127.11.83.65:38817 shutdown complete.
I20260618 20:07:14.481247 11597 test_util.cc:182] -----------------------------------------------
I20260618 20:07:14.481316 11597 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781813230966404-11597-0
[ FAILED ] TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData (3509 ms)
[ RUN ] TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap
I20260618 20:07:14.481801 11597 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.83.126:42843
I20260618 20:07:14.481941 11597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260618 20:07:14.483402 12165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:14.483439 12168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:14.483546 12166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 20:07:14.483464 11597 server_base.cc:1061] running on GCE node
I20260618 20:07:14.483745 11597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260618 20:07:14.483771 11597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260618 20:07:14.483783 11597 hybrid_clock.cc:648] HybridClock initialized: now 1781813234483784 us; error 0 us; skew 500 ppm
I20260618 20:07:14.484421 11597 webserver.cc:533] Webserver started at http://127.11.83.126:44367/ using document root <none> and password file <none>
I20260618 20:07:14.484527 11597 fs_manager.cc:362] Metadata directory not provided
I20260618 20:07:14.484581 11597 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 20:07:14.484630 11597 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 20:07:14.484922 11597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781813230966404-11597-0/minicluster-data/master-0-root/instance:
uuid: "27efdea2abde47a79f10b10a385696ba"
format_stamp: "Formatted at 2026-06-18 20:07:14 on dist-test-slave-szgn"
I20260618 20:07:14.485883 11597 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260618 20:07:14.486457 12173 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:14.486757 11597 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260618 20:07:14.486825 11597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781813230966404-11597-0/minicluster-data/master-0-root
uuid: "27efdea2abde47a79f10b10a385696ba"
format_stamp: "Formatted at 2026-06-18 20:07:14 on dist-test-slave-szgn"
I20260618 20:07:14.486881 11597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781813230966404-11597-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781813230966404-11597-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781813230966404-11597-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 20:07:14.495862 11597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 20:07:14.496127 11597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 20:07:14.499063 11597 rpc_server.cc:307] RPC server started. Bound to: 127.11.83.126:42843
I20260618 20:07:14.499850 12225 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.83.126:42843 every 8 connection(s)
I20260618 20:07:14.499967 12226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 20:07:14.501017 12226 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27efdea2abde47a79f10b10a385696ba: Bootstrap starting.
I20260618 20:07:14.501291 12226 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 27efdea2abde47a79f10b10a385696ba: Neither blocks nor log segments found. Creating new log.
I20260618 20:07:14.501825 12226 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27efdea2abde47a79f10b10a385696ba: No bootstrap required, opened a new log
I20260618 20:07:14.501935 12226 raft_consensus.cc:359] T 00000000000000000000000000000000 P 27efdea2abde47a79f10b10a385696ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27efdea2abde47a79f10b10a385696ba" member_type: VOTER }
I20260618 20:07:14.501981 12226 raft_consensus.cc:385] T 00000000000000000000000000000000 P 27efdea2abde47a79f10b10a385696ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 20:07:14.501995 12226 raft_consensus.cc:740] T 00000000000000000000000000000000 P 27efdea2abde47a79f10b10a385696ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27efdea2abde47a79f10b10a385696ba, State: Initialized, Role: FOLLOWER
I20260618 20:07:14.502102 12226 consensus_queue.cc:260] T 00000000000000000000000000000000 P 27efdea2abde47a79f10b10a385696ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27efdea2abde47a79f10b10a385696ba" member_type: VOTER }
I20260618 20:07:14.502144 12226 raft_consensus.cc:399] T 00000000000000000000000000000000 P 27efdea2abde47a79f10b10a385696ba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 20:07:14.502177 12226 raft_consensus.cc:493] T 00000000000000000000000000000000 P 27efdea2abde47a79f10b10a385696ba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 20:07:14.502205 12226 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 27efdea2abde47a79f10b10a385696ba [term 0 FOLLOWER]: Advancing to term 1
I20260618 20:07:14.502743 12226 raft_consensus.cc:515] T 00000000000000000000000000000000 P 27efdea2abde47a79f10b10a385696ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27efdea2abde47a79f10b10a385696ba" member_type: VOTER }
I20260618 20:07:14.502835 12226 leader_election.cc:304] T 00000000000000000000000000000000 P 27efdea2abde47a79f10b10a385696ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 27efdea2abde47a79f10b10a385696ba; no voters:
I20260618 20:07:14.502969 12226 leader_election.cc:290] T 00000000000000000000000000000000 P 27efdea2abde47a79f10b10a385696ba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 20:07:14.503014 12229 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 27efdea2abde47a79f10b10a385696ba [term 1 FOLLOWER]: Leader election won for term 1
I20260618 20:07:14.503118 12229 raft_consensus.cc:697] T 00000000000000000000000000000000 P 27efdea2abde47a79f10b10a385696ba [term 1 LEADER]: Becoming Leader. State: Replica: 27efdea2abde47a79f10b10a385696ba, State: Running, Role: LEADER
I20260618 20:07:14.503140 12226 sys_catalog.cc:565] T 00000000000000000000000000000000 P 27efdea2abde47a79f10b10a385696ba [sys.catalog]: configured and running, proceeding with master startup.
I20260618 20:07:14.503768 12229 consensus_queue.cc:237] T 00000000000000000000000000000000 P 27efdea2abde47a79f10b10a385696ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27efdea2abde47a79f10b10a385696ba" member_type: VOTER }
I20260618 20:07:14.504045 12231 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27efdea2abde47a79f10b10a385696ba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "27efdea2abde47a79f10b10a385696ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27efdea2abde47a79f10b10a385696ba" member_type: VOTER } }
I20260618 20:07:14.504062 12230 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27efdea2abde47a79f10b10a385696ba [sys.catalog]: SysCatalogTable state changed. Reason: New leader 27efdea2abde47a79f10b10a385696ba. Latest consensus state: current_term: 1 leader_uuid: "27efdea2abde47a79f10b10a385696ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27efdea2abde47a79f10b10a385696ba" member_type: VOTER } }
I20260618 20:07:14.504133 12231 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27efdea2abde47a79f10b10a385696ba [sys.catalog]: This master's current role is: LEADER
I20260618 20:07:14.504146 12230 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27efdea2abde47a79f10b10a385696ba [sys.catalog]: This master's current role is: LEADER
I20260618 20:07:14.504426 12238 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260618 20:07:14.504619 12238 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260618 20:07:14.504803 11597 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260618 20:07:14.505236 12238 catalog_manager.cc:1382] Generated new cluster ID: 212bf4e55af34a84b02a7a15ec9fc47f
I20260618 20:07:14.505282 12238 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260618 20:07:14.510470 12238 catalog_manager.cc:1405] Generated new certificate authority record
I20260618 20:07:14.510984 12238 catalog_manager.cc:1539] Loading token signing keys...
I20260618 20:07:14.521646 12238 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 27efdea2abde47a79f10b10a385696ba: Generated new TSK 0
I20260618 20:07:14.521767 12238 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260618 20:07:14.536815 11597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260618 20:07:14.537019 11597 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260618 20:07:14.538573 12248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:14.538575 12247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:14.538633 12250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 20:07:14.538763 11597 server_base.cc:1061] running on GCE node
I20260618 20:07:14.538882 11597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260618 20:07:14.538924 11597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260618 20:07:14.538949 11597 hybrid_clock.cc:648] HybridClock initialized: now 1781813234538948 us; error 0 us; skew 500 ppm
I20260618 20:07:14.539541 11597 webserver.cc:533] Webserver started at http://127.11.83.65:43237/ using document root <none> and password file <none>
I20260618 20:07:14.539652 11597 fs_manager.cc:362] Metadata directory not provided
I20260618 20:07:14.539706 11597 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 20:07:14.539767 11597 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 20:07:14.540058 11597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781813230966404-11597-0/minicluster-data/ts-0-root/instance:
uuid: "b15891c9ffe346c28878d91e55a1628b"
format_stamp: "Formatted at 2026-06-18 20:07:14 on dist-test-slave-szgn"
I20260618 20:07:14.541052 11597 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260618 20:07:14.541549 12255 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:14.541689 11597 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:14.541749 11597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781813230966404-11597-0/minicluster-data/ts-0-root
uuid: "b15891c9ffe346c28878d91e55a1628b"
format_stamp: "Formatted at 2026-06-18 20:07:14 on dist-test-slave-szgn"
I20260618 20:07:14.541819 11597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781813230966404-11597-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781813230966404-11597-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781813230966404-11597-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 20:07:14.550781 11597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 20:07:14.551084 11597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 20:07:14.551261 11597 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260618 20:07:14.551482 11597 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 20:07:14.551532 11597 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:14.551576 11597 ts_tablet_manager.cc:616] Registered 0 tablets
I20260618 20:07:14.551602 11597 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:14.554502 11597 rpc_server.cc:307] RPC server started. Bound to: 127.11.83.65:42619
I20260618 20:07:14.554544 12318 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.83.65:42619 every 8 connection(s)
I20260618 20:07:14.554915 11597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260618 20:07:14.555054 11597 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260618 20:07:14.556597 12324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:14.556706 12326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:14.556612 12323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 20:07:14.557332 11597 server_base.cc:1061] running on GCE node
I20260618 20:07:14.557475 11597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260618 20:07:14.557514 11597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260618 20:07:14.557533 11597 hybrid_clock.cc:648] HybridClock initialized: now 1781813234557534 us; error 0 us; skew 500 ppm
I20260618 20:07:14.558944 11597 webserver.cc:533] Webserver started at http://127.11.83.66:45699/ using document root <none> and password file <none>
I20260618 20:07:14.559062 11597 fs_manager.cc:362] Metadata directory not provided
I20260618 20:07:14.559121 11597 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 20:07:14.559175 11597 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 20:07:14.559536 11597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781813230966404-11597-0/minicluster-data/ts-1-root/instance:
uuid: "efde4047cf9a4c4aaae40355613e94a9"
format_stamp: "Formatted at 2026-06-18 20:07:14 on dist-test-slave-szgn"
I20260618 20:07:14.559756 12319 heartbeater.cc:344] Connected to a master server at 127.11.83.126:42843
I20260618 20:07:14.559824 12319 heartbeater.cc:461] Registering TS with master...
I20260618 20:07:14.559947 12319 heartbeater.cc:507] Master 127.11.83.126:42843 requested a full tablet report, sending...
I20260618 20:07:14.560223 12190 ts_manager.cc:194] Registered new tserver with Master: b15891c9ffe346c28878d91e55a1628b (127.11.83.65:42619)
I20260618 20:07:14.560755 11597 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260618 20:07:14.561058 12190 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54476
I20260618 20:07:14.561342 12331 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:14.561468 11597 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:14.561517 11597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781813230966404-11597-0/minicluster-data/ts-1-root
uuid: "efde4047cf9a4c4aaae40355613e94a9"
format_stamp: "Formatted at 2026-06-18 20:07:14 on dist-test-slave-szgn"
I20260618 20:07:14.561568 11597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781813230966404-11597-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781813230966404-11597-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781813230966404-11597-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 20:07:14.568953 11597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 20:07:14.569231 11597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 20:07:14.569415 11597 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260618 20:07:14.569890 11597 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 20:07:14.569931 11597 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:14.569954 11597 ts_tablet_manager.cc:616] Registered 0 tablets
I20260618 20:07:14.569967 11597 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:14.574092 11597 rpc_server.cc:307] RPC server started. Bound to: 127.11.83.66:37413
I20260618 20:07:14.574139 12394 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.83.66:37413 every 8 connection(s)
I20260618 20:07:14.574625 11597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260618 20:07:14.574834 11597 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260618 20:07:14.576086 12398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:14.576212 12401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:14.576259 12399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 20:07:14.576586 11597 server_base.cc:1061] running on GCE node
I20260618 20:07:14.576735 11597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260618 20:07:14.576772 11597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260618 20:07:14.576790 11597 hybrid_clock.cc:648] HybridClock initialized: now 1781813234576790 us; error 0 us; skew 500 ppm
I20260618 20:07:14.577608 11597 webserver.cc:533] Webserver started at http://127.11.83.67:45909/ using document root <none> and password file <none>
I20260618 20:07:14.577711 11597 fs_manager.cc:362] Metadata directory not provided
I20260618 20:07:14.577770 11597 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 20:07:14.577818 11597 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 20:07:14.577988 12395 heartbeater.cc:344] Connected to a master server at 127.11.83.126:42843
I20260618 20:07:14.578065 12395 heartbeater.cc:461] Registering TS with master...
I20260618 20:07:14.578195 12395 heartbeater.cc:507] Master 127.11.83.126:42843 requested a full tablet report, sending...
I20260618 20:07:14.578215 11597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781813230966404-11597-0/minicluster-data/ts-2-root/instance:
uuid: "1afb08504e25405282a61e5751299960"
format_stamp: "Formatted at 2026-06-18 20:07:14 on dist-test-slave-szgn"
I20260618 20:07:14.578449 12190 ts_manager.cc:194] Registered new tserver with Master: efde4047cf9a4c4aaae40355613e94a9 (127.11.83.66:37413)
I20260618 20:07:14.578962 12190 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54486
I20260618 20:07:14.579406 11597 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260618 20:07:14.579978 12406 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:14.580122 11597 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:14.580175 11597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781813230966404-11597-0/minicluster-data/ts-2-root
uuid: "1afb08504e25405282a61e5751299960"
format_stamp: "Formatted at 2026-06-18 20:07:14 on dist-test-slave-szgn"
I20260618 20:07:14.580224 11597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781813230966404-11597-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781813230966404-11597-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781813230966404-11597-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 20:07:14.591776 11597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 20:07:14.592053 11597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 20:07:14.592216 11597 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260618 20:07:14.592447 11597 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 20:07:14.592479 11597 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:14.592502 11597 ts_tablet_manager.cc:616] Registered 0 tablets
I20260618 20:07:14.592543 11597 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:14.596063 11597 rpc_server.cc:307] RPC server started. Bound to: 127.11.83.67:45079
I20260618 20:07:14.596160 12469 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.83.67:45079 every 8 connection(s)
I20260618 20:07:14.599572 12470 heartbeater.cc:344] Connected to a master server at 127.11.83.126:42843
I20260618 20:07:14.599647 12470 heartbeater.cc:461] Registering TS with master...
I20260618 20:07:14.599871 12470 heartbeater.cc:507] Master 127.11.83.126:42843 requested a full tablet report, sending...
I20260618 20:07:14.600147 12190 ts_manager.cc:194] Registered new tserver with Master: 1afb08504e25405282a61e5751299960 (127.11.83.67:45079)
I20260618 20:07:14.600513 12190 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54500
I20260618 20:07:14.600821 11597 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.00449655s
I20260618 20:07:14.613976 12190 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54514:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260618 20:07:14.614217 12190 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 20:07:14.619319 12434 tablet_service.cc:1511] Processing CreateTablet for tablet 33074adf121e4604ad57da8b01cc5ae0 (DEFAULT_TABLE table=test-workload [id=a2dc3c1dd52f4333a32a2d550e341e2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 20:07:14.619506 12434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33074adf121e4604ad57da8b01cc5ae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 20:07:14.619506 12283 tablet_service.cc:1511] Processing CreateTablet for tablet 33074adf121e4604ad57da8b01cc5ae0 (DEFAULT_TABLE table=test-workload [id=a2dc3c1dd52f4333a32a2d550e341e2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 20:07:14.619638 12283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33074adf121e4604ad57da8b01cc5ae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 20:07:14.621043 12359 tablet_service.cc:1511] Processing CreateTablet for tablet 33074adf121e4604ad57da8b01cc5ae0 (DEFAULT_TABLE table=test-workload [id=a2dc3c1dd52f4333a32a2d550e341e2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 20:07:14.621116 12492 tablet_bootstrap.cc:492] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b: Bootstrap starting.
I20260618 20:07:14.621184 12359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33074adf121e4604ad57da8b01cc5ae0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 20:07:14.621059 12491 tablet_bootstrap.cc:492] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960: Bootstrap starting.
I20260618 20:07:14.621714 12492 tablet_bootstrap.cc:654] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b: Neither blocks nor log segments found. Creating new log.
I20260618 20:07:14.621783 12491 tablet_bootstrap.cc:654] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960: Neither blocks nor log segments found. Creating new log.
I20260618 20:07:14.622313 12492 tablet_bootstrap.cc:492] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b: No bootstrap required, opened a new log
I20260618 20:07:14.622359 12492 ts_tablet_manager.cc:1403] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260618 20:07:14.622391 12491 tablet_bootstrap.cc:492] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960: No bootstrap required, opened a new log
I20260618 20:07:14.622428 12491 ts_tablet_manager.cc:1403] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260618 20:07:14.622545 12491 raft_consensus.cc:359] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:14.622530 12492 raft_consensus.cc:359] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:14.622596 12491 raft_consensus.cc:385] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 20:07:14.622603 12492 raft_consensus.cc:385] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 20:07:14.622610 12491 raft_consensus.cc:740] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1afb08504e25405282a61e5751299960, State: Initialized, Role: FOLLOWER
I20260618 20:07:14.622643 12492 raft_consensus.cc:740] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b15891c9ffe346c28878d91e55a1628b, State: Initialized, Role: FOLLOWER
I20260618 20:07:14.622704 12491 consensus_queue.cc:260] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:14.622699 12492 consensus_queue.cc:260] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:14.622900 12491 ts_tablet_manager.cc:1434] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260618 20:07:14.622923 12492 ts_tablet_manager.cc:1434] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260618 20:07:14.622984 12470 heartbeater.cc:499] Master 127.11.83.126:42843 was elected leader, sending a full tablet report...
I20260618 20:07:14.623008 12319 heartbeater.cc:499] Master 127.11.83.126:42843 was elected leader, sending a full tablet report...
I20260618 20:07:14.623193 12495 tablet_bootstrap.cc:492] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9: Bootstrap starting.
I20260618 20:07:14.623718 12495 tablet_bootstrap.cc:654] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9: Neither blocks nor log segments found. Creating new log.
I20260618 20:07:14.624364 12495 tablet_bootstrap.cc:492] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9: No bootstrap required, opened a new log
I20260618 20:07:14.624431 12495 ts_tablet_manager.cc:1403] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260618 20:07:14.624616 12495 raft_consensus.cc:359] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:14.624697 12495 raft_consensus.cc:385] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 20:07:14.624722 12495 raft_consensus.cc:740] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efde4047cf9a4c4aaae40355613e94a9, State: Initialized, Role: FOLLOWER
I20260618 20:07:14.624776 12495 consensus_queue.cc:260] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:14.624972 12495 ts_tablet_manager.cc:1434] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260618 20:07:14.625001 12395 heartbeater.cc:499] Master 127.11.83.126:42843 was elected leader, sending a full tablet report...
I20260618 20:07:14.682228 12497 raft_consensus.cc:493] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 20:07:14.682340 12497 raft_consensus.cc:515] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:14.682513 12497 leader_election.cc:290] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1afb08504e25405282a61e5751299960 (127.11.83.67:45079), efde4047cf9a4c4aaae40355613e94a9 (127.11.83.66:37413)
I20260618 20:07:14.685279 12442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "b15891c9ffe346c28878d91e55a1628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1afb08504e25405282a61e5751299960" is_pre_election: true
I20260618 20:07:14.685422 12442 raft_consensus.cc:2468] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b15891c9ffe346c28878d91e55a1628b in term 0.
I20260618 20:07:14.685599 12256 leader_election.cc:304] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1afb08504e25405282a61e5751299960, b15891c9ffe346c28878d91e55a1628b; no voters:
I20260618 20:07:14.685715 12497 raft_consensus.cc:2804] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 20:07:14.685781 12497 raft_consensus.cc:493] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 20:07:14.685807 12497 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 0 FOLLOWER]: Advancing to term 1
I20260618 20:07:14.685966 12369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "b15891c9ffe346c28878d91e55a1628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efde4047cf9a4c4aaae40355613e94a9" is_pre_election: true
I20260618 20:07:14.686096 12369 raft_consensus.cc:2468] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b15891c9ffe346c28878d91e55a1628b in term 0.
I20260618 20:07:14.686628 12497 raft_consensus.cc:515] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:14.686776 12497 leader_election.cc:290] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [CANDIDATE]: Term 1 election: Requested vote from peers 1afb08504e25405282a61e5751299960 (127.11.83.67:45079), efde4047cf9a4c4aaae40355613e94a9 (127.11.83.66:37413)
I20260618 20:07:14.686990 12442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "b15891c9ffe346c28878d91e55a1628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1afb08504e25405282a61e5751299960"
I20260618 20:07:14.686998 12369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "b15891c9ffe346c28878d91e55a1628b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efde4047cf9a4c4aaae40355613e94a9"
I20260618 20:07:14.687114 12442 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 0 FOLLOWER]: Advancing to term 1
I20260618 20:07:14.687126 12369 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 0 FOLLOWER]: Advancing to term 1
I20260618 20:07:14.687841 12369 raft_consensus.cc:2468] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b15891c9ffe346c28878d91e55a1628b in term 1.
I20260618 20:07:14.687865 12442 raft_consensus.cc:2468] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b15891c9ffe346c28878d91e55a1628b in term 1.
I20260618 20:07:14.688030 12256 leader_election.cc:304] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b15891c9ffe346c28878d91e55a1628b, efde4047cf9a4c4aaae40355613e94a9; no voters:
I20260618 20:07:14.688148 12497 raft_consensus.cc:2804] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 1 FOLLOWER]: Leader election won for term 1
I20260618 20:07:14.688336 12497 raft_consensus.cc:697] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 1 LEADER]: Becoming Leader. State: Replica: b15891c9ffe346c28878d91e55a1628b, State: Running, Role: LEADER
I20260618 20:07:14.688411 12497 consensus_queue.cc:237] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:14.689049 12190 catalog_manager.cc:5696] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b reported cstate change: term changed from 0 to 1, leader changed from <none> to b15891c9ffe346c28878d91e55a1628b (127.11.83.65). New cstate: current_term: 1 leader_uuid: "b15891c9ffe346c28878d91e55a1628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } health_report { overall_health: UNKNOWN } } }
I20260618 20:07:14.695303 12442 raft_consensus.cc:1275] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 1 FOLLOWER]: Refusing update from remote peer b15891c9ffe346c28878d91e55a1628b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 20:07:14.695302 12369 raft_consensus.cc:1275] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 1 FOLLOWER]: Refusing update from remote peer b15891c9ffe346c28878d91e55a1628b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 20:07:14.695596 12501 consensus_queue.cc:1048] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 20:07:14.695680 12497 consensus_queue.cc:1048] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 20:07:14.697476 12509 mvcc.cc:204] Tried to move back new op lower bound from 7298307009311203328 to 7298307009284268032. Current Snapshot: MvccSnapshot[applied={T|T < 7298307009310167040}]
I20260618 20:07:15.000945 12496 raft_consensus.cc:493] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b15891c9ffe346c28878d91e55a1628b)
I20260618 20:07:15.001046 12496 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 1 FOLLOWER]: Advancing to term 2
I20260618 20:07:15.001896 12496 raft_consensus.cc:515] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:15.002185 12496 leader_election.cc:290] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [CANDIDATE]: Term 2 election: Requested vote from peers b15891c9ffe346c28878d91e55a1628b (127.11.83.65:42619), efde4047cf9a4c4aaae40355613e94a9 (127.11.83.66:37413)
I20260618 20:07:15.005918 12369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "1afb08504e25405282a61e5751299960" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "efde4047cf9a4c4aaae40355613e94a9"
I20260618 20:07:15.005942 12293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "1afb08504e25405282a61e5751299960" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "b15891c9ffe346c28878d91e55a1628b"
I20260618 20:07:15.006302 12408 leader_election.cc:304] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1afb08504e25405282a61e5751299960; no voters: b15891c9ffe346c28878d91e55a1628b, efde4047cf9a4c4aaae40355613e94a9
I20260618 20:07:15.006515 12496 raft_consensus.cc:2749] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260618 20:07:15.016028 12442 raft_consensus.cc:1240] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 2 FOLLOWER]: Rejecting Update request from peer b15891c9ffe346c28878d91e55a1628b for earlier term 1. Current term is 2. Ops: []
I20260618 20:07:15.016381 12497 consensus_queue.cc:1059] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 }, Status: INVALID_TERM, Last received: 1.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260618 20:07:15.046669 12522 raft_consensus.cc:3055] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 1 LEADER]: Stepping down as leader of term 1
I20260618 20:07:15.046772 12522 raft_consensus.cc:740] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b15891c9ffe346c28878d91e55a1628b, State: Running, Role: LEADER
I20260618 20:07:15.046859 12522 consensus_queue.cc:260] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 1.15, Last appended by leader: 15, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:15.047016 12522 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 1 FOLLOWER]: Advancing to term 2
I20260618 20:07:15.072647 12499 raft_consensus.cc:493] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b15891c9ffe346c28878d91e55a1628b)
I20260618 20:07:15.072772 12499 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 1 FOLLOWER]: Advancing to term 2
I20260618 20:07:15.073662 12499 raft_consensus.cc:515] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:15.073925 12499 leader_election.cc:290] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [CANDIDATE]: Term 2 election: Requested vote from peers 1afb08504e25405282a61e5751299960 (127.11.83.67:45079), b15891c9ffe346c28878d91e55a1628b (127.11.83.65:42619)
I20260618 20:07:15.076931 12293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "efde4047cf9a4c4aaae40355613e94a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "b15891c9ffe346c28878d91e55a1628b"
I20260618 20:07:15.077072 12442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "efde4047cf9a4c4aaae40355613e94a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "1afb08504e25405282a61e5751299960"
I20260618 20:07:15.077204 12442 raft_consensus.cc:2393] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate efde4047cf9a4c4aaae40355613e94a9 in current term 2: Already voted for candidate 1afb08504e25405282a61e5751299960 in this term.
I20260618 20:07:15.077893 12293 raft_consensus.cc:2468] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efde4047cf9a4c4aaae40355613e94a9 in term 2.
I20260618 20:07:15.078166 12333 leader_election.cc:304] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b15891c9ffe346c28878d91e55a1628b, efde4047cf9a4c4aaae40355613e94a9; no voters: 1afb08504e25405282a61e5751299960
I20260618 20:07:15.078297 12499 raft_consensus.cc:2804] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260618 20:07:15.078413 12499 raft_consensus.cc:697] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 2 LEADER]: Becoming Leader. State: Replica: efde4047cf9a4c4aaae40355613e94a9, State: Running, Role: LEADER
I20260618 20:07:15.078469 12499 consensus_queue.cc:237] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 1.15, Last appended by leader: 15, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:15.079010 12190 catalog_manager.cc:5696] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 reported cstate change: term changed from 1 to 2, leader changed from b15891c9ffe346c28878d91e55a1628b (127.11.83.65) to efde4047cf9a4c4aaae40355613e94a9 (127.11.83.66). New cstate: current_term: 2 leader_uuid: "efde4047cf9a4c4aaae40355613e94a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } health_report { overall_health: HEALTHY } } }
I20260618 20:07:15.143666 12496 raft_consensus.cc:493] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 20:07:15.143807 12496 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 2 FOLLOWER]: Advancing to term 3
I20260618 20:07:15.144531 12496 raft_consensus.cc:515] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:15.144809 12496 leader_election.cc:290] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [CANDIDATE]: Term 3 election: Requested vote from peers b15891c9ffe346c28878d91e55a1628b (127.11.83.65:42619), efde4047cf9a4c4aaae40355613e94a9 (127.11.83.66:37413)
I20260618 20:07:15.145061 12369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "1afb08504e25405282a61e5751299960" candidate_term: 3 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "efde4047cf9a4c4aaae40355613e94a9"
I20260618 20:07:15.145061 12293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "1afb08504e25405282a61e5751299960" candidate_term: 3 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "b15891c9ffe346c28878d91e55a1628b"
I20260618 20:07:15.145223 12293 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 2 FOLLOWER]: Advancing to term 3
I20260618 20:07:15.145936 12293 raft_consensus.cc:2468] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1afb08504e25405282a61e5751299960 in term 3.
I20260618 20:07:15.146292 12408 leader_election.cc:304] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1afb08504e25405282a61e5751299960, b15891c9ffe346c28878d91e55a1628b; no voters: efde4047cf9a4c4aaae40355613e94a9
I20260618 20:07:15.146481 12496 raft_consensus.cc:2804] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 3 FOLLOWER]: Leader election won for term 3
I20260618 20:07:15.146654 12496 raft_consensus.cc:697] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 3 LEADER]: Becoming Leader. State: Replica: 1afb08504e25405282a61e5751299960, State: Running, Role: LEADER
I20260618 20:07:15.146785 12496 consensus_queue.cc:237] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 1.15, Last appended by leader: 15, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:15.158195 12189 catalog_manager.cc:5696] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 reported cstate change: term changed from 2 to 3, leader changed from efde4047cf9a4c4aaae40355613e94a9 (127.11.83.66) to 1afb08504e25405282a61e5751299960 (127.11.83.67). New cstate: current_term: 3 leader_uuid: "1afb08504e25405282a61e5751299960" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } health_report { overall_health: UNKNOWN } } }
I20260618 20:07:15.167503 12442 raft_consensus.cc:1240] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 3 LEADER]: Rejecting Update request from peer efde4047cf9a4c4aaae40355613e94a9 for earlier term 2. Current term is 3. Ops: []
I20260618 20:07:15.167979 12499 consensus_queue.cc:1059] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260618 20:07:15.168097 12499 consensus_queue.cc:1243] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [LEADER]: Peer 1afb08504e25405282a61e5751299960 log is divergent from this leader: its last log entry 3.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260618 20:07:15.186673 12293 raft_consensus.cc:1240] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 3 FOLLOWER]: Rejecting Update request from peer efde4047cf9a4c4aaae40355613e94a9 for earlier term 2. Current term is 3. Ops: []
I20260618 20:07:15.186998 12529 consensus_queue.cc:1059] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260618 20:07:15.194238 12499 raft_consensus.cc:3055] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 2 LEADER]: Stepping down as leader of term 2
I20260618 20:07:15.194375 12499 raft_consensus.cc:740] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: efde4047cf9a4c4aaae40355613e94a9, State: Running, Role: LEADER
I20260618 20:07:15.194481 12499 consensus_queue.cc:260] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 2.16, Last appended by leader: 16, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:15.194614 12499 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 2 FOLLOWER]: Advancing to term 3
I20260618 20:07:15.251086 12369 raft_consensus.cc:1275] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 3 FOLLOWER]: Refusing update from remote peer 1afb08504e25405282a61e5751299960: Log matching property violated. Preceding OpId in replica: term: 2 index: 16. Preceding OpId from leader: term: 3 index: 16. (term mismatch)
I20260618 20:07:15.251183 12369 pending_rounds.cc:85] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9: Aborting all ops after (but not including) 15
I20260618 20:07:15.251205 12369 pending_rounds.cc:107] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9: Aborting uncommitted NO_OP operation due to leader change: 2.16
I20260618 20:07:15.251232 12369 raft_consensus.cc:2889] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260618 20:07:15.251539 12496 consensus_queue.cc:1048] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260618 20:07:15.266106 12293 raft_consensus.cc:1275] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 3 FOLLOWER]: Refusing update from remote peer 1afb08504e25405282a61e5751299960: Log matching property violated. Preceding OpId in replica: term: 1 index: 15. Preceding OpId from leader: term: 3 index: 16. (index mismatch)
I20260618 20:07:15.266518 12496 consensus_queue.cc:1048] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260618 20:07:15.434402 12499 raft_consensus.cc:493] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1afb08504e25405282a61e5751299960)
I20260618 20:07:15.434522 12499 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 3 FOLLOWER]: Advancing to term 4
I20260618 20:07:15.435295 12499 raft_consensus.cc:515] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:15.435487 12499 leader_election.cc:290] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [CANDIDATE]: Term 4 election: Requested vote from peers 1afb08504e25405282a61e5751299960 (127.11.83.67:45079), b15891c9ffe346c28878d91e55a1628b (127.11.83.65:42619)
I20260618 20:07:15.435708 12293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "efde4047cf9a4c4aaae40355613e94a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 16 } } ignore_live_leader: false dest_uuid: "b15891c9ffe346c28878d91e55a1628b"
I20260618 20:07:15.435708 12442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "efde4047cf9a4c4aaae40355613e94a9" candidate_term: 4 candidate_status { last_received { term: 3 index: 16 } } ignore_live_leader: false dest_uuid: "1afb08504e25405282a61e5751299960"
I20260618 20:07:15.436007 12332 leader_election.cc:304] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efde4047cf9a4c4aaae40355613e94a9; no voters: 1afb08504e25405282a61e5751299960, b15891c9ffe346c28878d91e55a1628b
I20260618 20:07:15.436122 12499 raft_consensus.cc:2749] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260618 20:07:15.452688 12369 raft_consensus.cc:1240] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 4 FOLLOWER]: Rejecting Update request from peer 1afb08504e25405282a61e5751299960 for earlier term 3. Current term is 4. Ops: []
I20260618 20:07:15.453132 12534 consensus_queue.cc:1059] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 }, Status: INVALID_TERM, Last received: 3.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260618 20:07:15.465051 12522 raft_consensus.cc:493] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1afb08504e25405282a61e5751299960)
I20260618 20:07:15.465188 12522 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 3 FOLLOWER]: Advancing to term 4
I20260618 20:07:15.465965 12522 raft_consensus.cc:515] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:15.466260 12522 leader_election.cc:290] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [CANDIDATE]: Term 4 election: Requested vote from peers 1afb08504e25405282a61e5751299960 (127.11.83.67:45079), efde4047cf9a4c4aaae40355613e94a9 (127.11.83.66:37413)
I20260618 20:07:15.466513 12442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "b15891c9ffe346c28878d91e55a1628b" candidate_term: 4 candidate_status { last_received { term: 3 index: 16 } } ignore_live_leader: false dest_uuid: "1afb08504e25405282a61e5751299960"
I20260618 20:07:15.466513 12369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "b15891c9ffe346c28878d91e55a1628b" candidate_term: 4 candidate_status { last_received { term: 3 index: 16 } } ignore_live_leader: false dest_uuid: "efde4047cf9a4c4aaae40355613e94a9"
I20260618 20:07:15.466634 12369 raft_consensus.cc:2393] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b15891c9ffe346c28878d91e55a1628b in current term 4: Already voted for candidate efde4047cf9a4c4aaae40355613e94a9 in this term.
I20260618 20:07:15.466933 12256 leader_election.cc:304] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b15891c9ffe346c28878d91e55a1628b; no voters: 1afb08504e25405282a61e5751299960, efde4047cf9a4c4aaae40355613e94a9
I20260618 20:07:15.467099 12522 raft_consensus.cc:2749] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260618 20:07:15.484097 12293 raft_consensus.cc:1240] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 4 FOLLOWER]: Rejecting Update request from peer 1afb08504e25405282a61e5751299960 for earlier term 3. Current term is 4. Ops: []
I20260618 20:07:15.484448 12530 consensus_queue.cc:1059] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 }, Status: INVALID_TERM, Last received: 3.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260618 20:07:15.496464 12534 raft_consensus.cc:3055] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 3 LEADER]: Stepping down as leader of term 3
I20260618 20:07:15.496578 12534 raft_consensus.cc:740] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1afb08504e25405282a61e5751299960, State: Running, Role: LEADER
I20260618 20:07:15.496719 12534 consensus_queue.cc:260] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 3.16, Last appended by leader: 16, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:15.496935 12534 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 3 FOLLOWER]: Advancing to term 4
I20260618 20:07:15.573799 12499 raft_consensus.cc:493] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 20:07:15.573956 12499 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 4 FOLLOWER]: Advancing to term 5
I20260618 20:07:15.574689 12499 raft_consensus.cc:515] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:15.574908 12499 leader_election.cc:290] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [CANDIDATE]: Term 5 election: Requested vote from peers 1afb08504e25405282a61e5751299960 (127.11.83.67:45079), b15891c9ffe346c28878d91e55a1628b (127.11.83.65:42619)
I20260618 20:07:15.575222 12293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "efde4047cf9a4c4aaae40355613e94a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 16 } } ignore_live_leader: false dest_uuid: "b15891c9ffe346c28878d91e55a1628b"
I20260618 20:07:15.575196 12442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "efde4047cf9a4c4aaae40355613e94a9" candidate_term: 5 candidate_status { last_received { term: 3 index: 16 } } ignore_live_leader: false dest_uuid: "1afb08504e25405282a61e5751299960"
I20260618 20:07:15.575336 12293 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 4 FOLLOWER]: Advancing to term 5
I20260618 20:07:15.575346 12442 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 4 FOLLOWER]: Advancing to term 5
I20260618 20:07:15.576098 12293 raft_consensus.cc:2468] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efde4047cf9a4c4aaae40355613e94a9 in term 5.
I20260618 20:07:15.576109 12442 raft_consensus.cc:2468] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efde4047cf9a4c4aaae40355613e94a9 in term 5.
I20260618 20:07:15.576349 12332 leader_election.cc:304] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1afb08504e25405282a61e5751299960, efde4047cf9a4c4aaae40355613e94a9; no voters:
I20260618 20:07:15.576484 12499 raft_consensus.cc:2804] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 5 FOLLOWER]: Leader election won for term 5
I20260618 20:07:15.576550 12499 raft_consensus.cc:697] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 5 LEADER]: Becoming Leader. State: Replica: efde4047cf9a4c4aaae40355613e94a9, State: Running, Role: LEADER
I20260618 20:07:15.576643 12499 consensus_queue.cc:237] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 3.16, Last appended by leader: 16, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:15.577224 12189 catalog_manager.cc:5696] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 reported cstate change: term changed from 3 to 5, leader changed from 1afb08504e25405282a61e5751299960 (127.11.83.67) to efde4047cf9a4c4aaae40355613e94a9 (127.11.83.66). New cstate: current_term: 5 leader_uuid: "efde4047cf9a4c4aaae40355613e94a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } health_report { overall_health: HEALTHY } } }
I20260618 20:07:15.661757 12293 raft_consensus.cc:1275] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 5 FOLLOWER]: Refusing update from remote peer efde4047cf9a4c4aaae40355613e94a9: Log matching property violated. Preceding OpId in replica: term: 3 index: 16. Preceding OpId from leader: term: 5 index: 17. (index mismatch)
I20260618 20:07:15.662190 12499 consensus_queue.cc:1048] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260618 20:07:15.690807 12442 raft_consensus.cc:1275] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 5 FOLLOWER]: Refusing update from remote peer efde4047cf9a4c4aaae40355613e94a9: Log matching property violated. Preceding OpId in replica: term: 3 index: 16. Preceding OpId from leader: term: 5 index: 17. (index mismatch)
I20260618 20:07:15.691149 12535 consensus_queue.cc:1048] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260618 20:07:15.853962 12522 raft_consensus.cc:493] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 5 FOLLOWER]: Starting leader election (detected failure of leader efde4047cf9a4c4aaae40355613e94a9)
I20260618 20:07:15.854100 12522 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 5 FOLLOWER]: Advancing to term 6
I20260618 20:07:15.854890 12522 raft_consensus.cc:515] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:15.855077 12522 leader_election.cc:290] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [CANDIDATE]: Term 6 election: Requested vote from peers 1afb08504e25405282a61e5751299960 (127.11.83.67:45079), efde4047cf9a4c4aaae40355613e94a9 (127.11.83.66:37413)
I20260618 20:07:15.855458 12369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "b15891c9ffe346c28878d91e55a1628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 17 } } ignore_live_leader: false dest_uuid: "efde4047cf9a4c4aaae40355613e94a9"
I20260618 20:07:15.855469 12442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "b15891c9ffe346c28878d91e55a1628b" candidate_term: 6 candidate_status { last_received { term: 5 index: 17 } } ignore_live_leader: false dest_uuid: "1afb08504e25405282a61e5751299960"
I20260618 20:07:15.855837 12256 leader_election.cc:304] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b15891c9ffe346c28878d91e55a1628b; no voters: 1afb08504e25405282a61e5751299960, efde4047cf9a4c4aaae40355613e94a9
I20260618 20:07:15.856002 12522 raft_consensus.cc:2749] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260618 20:07:15.869768 12293 raft_consensus.cc:1240] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 6 FOLLOWER]: Rejecting Update request from peer efde4047cf9a4c4aaae40355613e94a9 for earlier term 5. Current term is 6. Ops: []
I20260618 20:07:15.870082 12535 consensus_queue.cc:1059] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 }, Status: INVALID_TERM, Last received: 5.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260618 20:07:15.887380 12535 raft_consensus.cc:3055] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 5 LEADER]: Stepping down as leader of term 5
I20260618 20:07:15.887600 12535 raft_consensus.cc:740] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: efde4047cf9a4c4aaae40355613e94a9, State: Running, Role: LEADER
I20260618 20:07:15.887692 12535 consensus_queue.cc:260] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 5.17, Last appended by leader: 17, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:15.887850 12535 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 5 FOLLOWER]: Advancing to term 6
I20260618 20:07:15.970362 12534 raft_consensus.cc:493] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 5 FOLLOWER]: Starting leader election (detected failure of leader efde4047cf9a4c4aaae40355613e94a9)
I20260618 20:07:15.970518 12534 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 5 FOLLOWER]: Advancing to term 6
I20260618 20:07:15.971243 12534 raft_consensus.cc:515] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:15.971473 12534 leader_election.cc:290] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [CANDIDATE]: Term 6 election: Requested vote from peers b15891c9ffe346c28878d91e55a1628b (127.11.83.65:42619), efde4047cf9a4c4aaae40355613e94a9 (127.11.83.66:37413)
I20260618 20:07:15.971712 12293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "1afb08504e25405282a61e5751299960" candidate_term: 6 candidate_status { last_received { term: 5 index: 17 } } ignore_live_leader: false dest_uuid: "b15891c9ffe346c28878d91e55a1628b"
I20260618 20:07:15.971760 12369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "1afb08504e25405282a61e5751299960" candidate_term: 6 candidate_status { last_received { term: 5 index: 17 } } ignore_live_leader: false dest_uuid: "efde4047cf9a4c4aaae40355613e94a9"
I20260618 20:07:15.971817 12293 raft_consensus.cc:2393] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1afb08504e25405282a61e5751299960 in current term 6: Already voted for candidate b15891c9ffe346c28878d91e55a1628b in this term.
I20260618 20:07:15.972424 12369 raft_consensus.cc:2468] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1afb08504e25405282a61e5751299960 in term 6.
I20260618 20:07:15.972731 12407 leader_election.cc:304] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1afb08504e25405282a61e5751299960, efde4047cf9a4c4aaae40355613e94a9; no voters: b15891c9ffe346c28878d91e55a1628b
I20260618 20:07:15.972909 12534 raft_consensus.cc:2804] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 6 FOLLOWER]: Leader election won for term 6
I20260618 20:07:15.973045 12534 raft_consensus.cc:697] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 6 LEADER]: Becoming Leader. State: Replica: 1afb08504e25405282a61e5751299960, State: Running, Role: LEADER
I20260618 20:07:15.973107 12534 consensus_queue.cc:237] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 5.17, Last appended by leader: 17, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:15.973711 12189 catalog_manager.cc:5696] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 reported cstate change: term changed from 5 to 6, leader changed from efde4047cf9a4c4aaae40355613e94a9 (127.11.83.66) to 1afb08504e25405282a61e5751299960 (127.11.83.67). New cstate: current_term: 6 leader_uuid: "1afb08504e25405282a61e5751299960" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } health_report { overall_health: UNKNOWN } } }
I20260618 20:07:15.997475 12522 raft_consensus.cc:493] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 20:07:15.997596 12522 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 6 FOLLOWER]: Advancing to term 7
I20260618 20:07:15.998385 12522 raft_consensus.cc:515] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:15.998536 12522 leader_election.cc:290] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [CANDIDATE]: Term 7 election: Requested vote from peers 1afb08504e25405282a61e5751299960 (127.11.83.67:45079), efde4047cf9a4c4aaae40355613e94a9 (127.11.83.66:37413)
I20260618 20:07:15.998850 12369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "b15891c9ffe346c28878d91e55a1628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 17 } } ignore_live_leader: false dest_uuid: "efde4047cf9a4c4aaae40355613e94a9"
I20260618 20:07:15.998950 12369 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 6 FOLLOWER]: Advancing to term 7
I20260618 20:07:15.998852 12442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "b15891c9ffe346c28878d91e55a1628b" candidate_term: 7 candidate_status { last_received { term: 5 index: 17 } } ignore_live_leader: false dest_uuid: "1afb08504e25405282a61e5751299960"
I20260618 20:07:15.999631 12369 raft_consensus.cc:2468] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b15891c9ffe346c28878d91e55a1628b in term 7.
I20260618 20:07:15.999840 12256 leader_election.cc:304] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b15891c9ffe346c28878d91e55a1628b, efde4047cf9a4c4aaae40355613e94a9; no voters: 1afb08504e25405282a61e5751299960
I20260618 20:07:15.999948 12522 raft_consensus.cc:2804] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 7 FOLLOWER]: Leader election won for term 7
I20260618 20:07:16.000062 12522 raft_consensus.cc:697] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 7 LEADER]: Becoming Leader. State: Replica: b15891c9ffe346c28878d91e55a1628b, State: Running, Role: LEADER
I20260618 20:07:16.000106 12522 consensus_queue.cc:237] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 5.17, Last appended by leader: 17, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:16.030756 12190 catalog_manager.cc:5696] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b reported cstate change: term changed from 6 to 7, leader changed from 1afb08504e25405282a61e5751299960 (127.11.83.67) to b15891c9ffe346c28878d91e55a1628b (127.11.83.65). New cstate: current_term: 7 leader_uuid: "b15891c9ffe346c28878d91e55a1628b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } health_report { overall_health: UNKNOWN } } }
I20260618 20:07:16.069393 12293 raft_consensus.cc:1240] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 7 LEADER]: Rejecting Update request from peer 1afb08504e25405282a61e5751299960 for earlier term 6. Current term is 7. Ops: []
I20260618 20:07:16.069844 12534 consensus_queue.cc:1059] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260618 20:07:16.069985 12534 consensus_queue.cc:1243] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [LEADER]: Peer b15891c9ffe346c28878d91e55a1628b log is divergent from this leader: its last log entry 7.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 17
I20260618 20:07:16.074483 12369 raft_consensus.cc:1240] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 7 FOLLOWER]: Rejecting Update request from peer 1afb08504e25405282a61e5751299960 for earlier term 6. Current term is 7. Ops: []
I20260618 20:07:16.074958 12534 consensus_queue.cc:1059] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260618 20:07:16.097455 12369 raft_consensus.cc:1275] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 7 FOLLOWER]: Refusing update from remote peer b15891c9ffe346c28878d91e55a1628b: Log matching property violated. Preceding OpId in replica: term: 5 index: 17. Preceding OpId from leader: term: 7 index: 18. (index mismatch)
I20260618 20:07:16.097891 12522 consensus_queue.cc:1048] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260618 20:07:16.122946 12442 raft_consensus.cc:3055] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 6 LEADER]: Stepping down as leader of term 6
I20260618 20:07:16.123040 12442 raft_consensus.cc:740] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1afb08504e25405282a61e5751299960, State: Running, Role: LEADER
I20260618 20:07:16.123142 12442 consensus_queue.cc:260] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 6.18, Last appended by leader: 18, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:16.123245 12442 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 6 FOLLOWER]: Advancing to term 7
I20260618 20:07:16.123986 12442 raft_consensus.cc:1275] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 7 FOLLOWER]: Refusing update from remote peer b15891c9ffe346c28878d91e55a1628b: Log matching property violated. Preceding OpId in replica: term: 6 index: 18. Preceding OpId from leader: term: 7 index: 18. (term mismatch)
I20260618 20:07:16.124033 12442 pending_rounds.cc:85] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960: Aborting all ops after (but not including) 17
I20260618 20:07:16.124045 12442 pending_rounds.cc:107] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960: Aborting uncommitted NO_OP operation due to leader change: 6.18
I20260618 20:07:16.124060 12442 raft_consensus.cc:2889] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260618 20:07:16.124351 12522 consensus_queue.cc:1048] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260618 20:07:16.199393 12535 raft_consensus.cc:493] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b15891c9ffe346c28878d91e55a1628b)
I20260618 20:07:16.199553 12535 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 7 FOLLOWER]: Advancing to term 8
I20260618 20:07:16.200353 12535 raft_consensus.cc:515] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:16.200590 12535 leader_election.cc:290] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [CANDIDATE]: Term 8 election: Requested vote from peers 1afb08504e25405282a61e5751299960 (127.11.83.67:45079), b15891c9ffe346c28878d91e55a1628b (127.11.83.65:42619)
I20260618 20:07:16.200810 12293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "efde4047cf9a4c4aaae40355613e94a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 18 } } ignore_live_leader: false dest_uuid: "b15891c9ffe346c28878d91e55a1628b"
I20260618 20:07:16.200873 12442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "efde4047cf9a4c4aaae40355613e94a9" candidate_term: 8 candidate_status { last_received { term: 7 index: 18 } } ignore_live_leader: false dest_uuid: "1afb08504e25405282a61e5751299960"
I20260618 20:07:16.201153 12332 leader_election.cc:304] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efde4047cf9a4c4aaae40355613e94a9; no voters: 1afb08504e25405282a61e5751299960, b15891c9ffe346c28878d91e55a1628b
I20260618 20:07:16.201254 12535 raft_consensus.cc:2749] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260618 20:07:16.203678 12369 raft_consensus.cc:1240] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 8 FOLLOWER]: Rejecting Update request from peer b15891c9ffe346c28878d91e55a1628b for earlier term 7. Current term is 8. Ops: []
I20260618 20:07:16.203925 12538 consensus_queue.cc:1059] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 }, Status: INVALID_TERM, Last received: 7.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260618 20:07:16.303741 12535 raft_consensus.cc:493] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 20:07:16.303851 12535 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 8 FOLLOWER]: Advancing to term 9
I20260618 20:07:16.304812 12535 raft_consensus.cc:515] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:16.305002 12535 leader_election.cc:290] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [CANDIDATE]: Term 9 election: Requested vote from peers 1afb08504e25405282a61e5751299960 (127.11.83.67:45079), b15891c9ffe346c28878d91e55a1628b (127.11.83.65:42619)
I20260618 20:07:16.305207 12442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "efde4047cf9a4c4aaae40355613e94a9" candidate_term: 9 candidate_status { last_received { term: 7 index: 18 } } ignore_live_leader: false dest_uuid: "1afb08504e25405282a61e5751299960"
I20260618 20:07:16.305244 12293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "efde4047cf9a4c4aaae40355613e94a9" candidate_term: 9 candidate_status { last_received { term: 7 index: 18 } } ignore_live_leader: false dest_uuid: "b15891c9ffe346c28878d91e55a1628b"
I20260618 20:07:16.305521 12333 leader_election.cc:304] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: efde4047cf9a4c4aaae40355613e94a9; no voters: 1afb08504e25405282a61e5751299960, b15891c9ffe346c28878d91e55a1628b
I20260618 20:07:16.305655 12535 raft_consensus.cc:2749] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260618 20:07:16.311344 12369 raft_consensus.cc:1240] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 9 FOLLOWER]: Rejecting Update request from peer b15891c9ffe346c28878d91e55a1628b for earlier term 7. Current term is 9. Ops: []
I20260618 20:07:16.311698 12522 consensus_queue.cc:1059] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 }, Status: INVALID_TERM, Last received: 7.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260618 20:07:16.406805 12536 raft_consensus.cc:3055] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 7 LEADER]: Stepping down as leader of term 7
I20260618 20:07:16.406932 12536 raft_consensus.cc:740] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b15891c9ffe346c28878d91e55a1628b, State: Running, Role: LEADER
I20260618 20:07:16.407030 12536 consensus_queue.cc:260] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 7.18, Last appended by leader: 18, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:16.407160 12536 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 7 FOLLOWER]: Advancing to term 8
I20260618 20:07:16.424124 12496 raft_consensus.cc:493] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b15891c9ffe346c28878d91e55a1628b)
I20260618 20:07:16.424414 12496 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 7 FOLLOWER]: Advancing to term 8
I20260618 20:07:16.425295 12496 raft_consensus.cc:515] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:16.425583 12496 leader_election.cc:290] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [CANDIDATE]: Term 8 election: Requested vote from peers b15891c9ffe346c28878d91e55a1628b (127.11.83.65:42619), efde4047cf9a4c4aaae40355613e94a9 (127.11.83.66:37413)
I20260618 20:07:16.425812 12293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "1afb08504e25405282a61e5751299960" candidate_term: 8 candidate_status { last_received { term: 7 index: 18 } } ignore_live_leader: false dest_uuid: "b15891c9ffe346c28878d91e55a1628b"
I20260618 20:07:16.425907 12369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "1afb08504e25405282a61e5751299960" candidate_term: 8 candidate_status { last_received { term: 7 index: 18 } } ignore_live_leader: false dest_uuid: "efde4047cf9a4c4aaae40355613e94a9"
I20260618 20:07:16.426044 12369 raft_consensus.cc:2368] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1afb08504e25405282a61e5751299960 for earlier term 8. Current term is 9.
I20260618 20:07:16.426234 12407 leader_election.cc:400] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [CANDIDATE]: Term 8 election: Vote denied by peer efde4047cf9a4c4aaae40355613e94a9 (127.11.83.66:37413) with higher term. Message: Invalid argument: T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1afb08504e25405282a61e5751299960 for earlier term 8. Current term is 9.
I20260618 20:07:16.426266 12407 leader_election.cc:403] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260618 20:07:16.426344 12496 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 8 FOLLOWER]: Advancing to term 9
I20260618 20:07:16.426715 12293 raft_consensus.cc:2468] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1afb08504e25405282a61e5751299960 in term 8.
I20260618 20:07:16.426971 12496 raft_consensus.cc:2749] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer efde4047cf9a4c4aaae40355613e94a9 (127.11.83.66:37413) with higher term. Message: Invalid argument: T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1afb08504e25405282a61e5751299960 for earlier term 8. Current term is 9.
I20260618 20:07:16.498413 12535 raft_consensus.cc:493] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 20:07:16.498535 12535 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 9 FOLLOWER]: Advancing to term 10
I20260618 20:07:16.499338 12535 raft_consensus.cc:515] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:16.499679 12535 leader_election.cc:290] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [CANDIDATE]: Term 10 election: Requested vote from peers 1afb08504e25405282a61e5751299960 (127.11.83.67:45079), b15891c9ffe346c28878d91e55a1628b (127.11.83.65:42619)
I20260618 20:07:16.499836 12442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "efde4047cf9a4c4aaae40355613e94a9" candidate_term: 10 candidate_status { last_received { term: 7 index: 18 } } ignore_live_leader: false dest_uuid: "1afb08504e25405282a61e5751299960"
I20260618 20:07:16.499858 12293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "efde4047cf9a4c4aaae40355613e94a9" candidate_term: 10 candidate_status { last_received { term: 7 index: 18 } } ignore_live_leader: false dest_uuid: "b15891c9ffe346c28878d91e55a1628b"
I20260618 20:07:16.500005 12293 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 8 FOLLOWER]: Advancing to term 10
I20260618 20:07:16.499905 12442 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 9 FOLLOWER]: Advancing to term 10
I20260618 20:07:16.500708 12442 raft_consensus.cc:2468] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efde4047cf9a4c4aaae40355613e94a9 in term 10.
I20260618 20:07:16.500720 12293 raft_consensus.cc:2468] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efde4047cf9a4c4aaae40355613e94a9 in term 10.
I20260618 20:07:16.500947 12333 leader_election.cc:304] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b15891c9ffe346c28878d91e55a1628b, efde4047cf9a4c4aaae40355613e94a9; no voters:
I20260618 20:07:16.501056 12535 raft_consensus.cc:2804] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 10 FOLLOWER]: Leader election won for term 10
I20260618 20:07:16.501181 12535 raft_consensus.cc:697] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 10 LEADER]: Becoming Leader. State: Replica: efde4047cf9a4c4aaae40355613e94a9, State: Running, Role: LEADER
I20260618 20:07:16.501261 12535 consensus_queue.cc:237] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 7.18, Last appended by leader: 18, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:16.501760 12190 catalog_manager.cc:5696] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 reported cstate change: term changed from 7 to 10, leader changed from b15891c9ffe346c28878d91e55a1628b (127.11.83.65) to efde4047cf9a4c4aaae40355613e94a9 (127.11.83.66). New cstate: current_term: 10 leader_uuid: "efde4047cf9a4c4aaae40355613e94a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } health_report { overall_health: HEALTHY } } }
I20260618 20:07:16.606360 12442 raft_consensus.cc:1275] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 10 FOLLOWER]: Refusing update from remote peer efde4047cf9a4c4aaae40355613e94a9: Log matching property violated. Preceding OpId in replica: term: 7 index: 18. Preceding OpId from leader: term: 10 index: 19. (index mismatch)
I20260618 20:07:16.606771 12535 consensus_queue.cc:1048] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260618 20:07:16.616590 12293 raft_consensus.cc:1275] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 10 FOLLOWER]: Refusing update from remote peer efde4047cf9a4c4aaae40355613e94a9: Log matching property violated. Preceding OpId in replica: term: 7 index: 18. Preceding OpId from leader: term: 10 index: 19. (index mismatch)
I20260618 20:07:16.616957 12535 consensus_queue.cc:1048] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260618 20:07:16.879326 12536 raft_consensus.cc:493] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 10 FOLLOWER]: Starting leader election (detected failure of leader efde4047cf9a4c4aaae40355613e94a9)
I20260618 20:07:16.879446 12536 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 10 FOLLOWER]: Advancing to term 11
I20260618 20:07:16.880235 12536 raft_consensus.cc:515] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:16.880402 12536 leader_election.cc:290] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [CANDIDATE]: Term 11 election: Requested vote from peers 1afb08504e25405282a61e5751299960 (127.11.83.67:45079), efde4047cf9a4c4aaae40355613e94a9 (127.11.83.66:37413)
I20260618 20:07:16.880760 12442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "b15891c9ffe346c28878d91e55a1628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 19 } } ignore_live_leader: false dest_uuid: "1afb08504e25405282a61e5751299960"
I20260618 20:07:16.880846 12369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "b15891c9ffe346c28878d91e55a1628b" candidate_term: 11 candidate_status { last_received { term: 10 index: 19 } } ignore_live_leader: false dest_uuid: "efde4047cf9a4c4aaae40355613e94a9"
I20260618 20:07:16.881140 12256 leader_election.cc:304] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b15891c9ffe346c28878d91e55a1628b; no voters: 1afb08504e25405282a61e5751299960, efde4047cf9a4c4aaae40355613e94a9
I20260618 20:07:16.881269 12536 raft_consensus.cc:2749] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260618 20:07:16.884066 11597 timestamp_advancement-itest.cc:267] GCing logs...
I20260618 20:07:16.884181 11597 log_reader.cc:385] T 33074adf121e4604ad57da8b01cc5ae0: removed 1 log segments from log reader
I20260618 20:07:16.884245 11597 log.cc:1079] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b: Deleting log segment in path: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781813230966404-11597-0/minicluster-data/ts-0-root/wals/33074adf121e4604ad57da8b01cc5ae0/wal-000000001 (ops 1-15)
I20260618 20:07:16.884586 11597 timestamp_advancement-itest.cc:274] Shutting down cluster...
I20260618 20:07:16.884666 11597 master.cc:562] Master@127.11.83.126:42843 shutting down...
I20260618 20:07:16.894706 12293 raft_consensus.cc:1240] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 11 FOLLOWER]: Rejecting Update request from peer efde4047cf9a4c4aaae40355613e94a9 for earlier term 10. Current term is 11. Ops: []
I20260618 20:07:16.895043 12535 consensus_queue.cc:1059] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 }, Status: INVALID_TERM, Last received: 10.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260618 20:07:16.895220 12539 raft_consensus.cc:3055] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 10 LEADER]: Stepping down as leader of term 10
I20260618 20:07:16.895269 12539 raft_consensus.cc:740] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: efde4047cf9a4c4aaae40355613e94a9, State: Running, Role: LEADER
I20260618 20:07:16.895349 12539 consensus_queue.cc:260] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 10.19, Last appended by leader: 19, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:16.895449 12539 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 10 FOLLOWER]: Advancing to term 11
I20260618 20:07:16.972882 12496 raft_consensus.cc:493] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 10 FOLLOWER]: Starting leader election (detected failure of leader efde4047cf9a4c4aaae40355613e94a9)
I20260618 20:07:16.973027 12496 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 10 FOLLOWER]: Advancing to term 11
I20260618 20:07:16.973839 12496 raft_consensus.cc:515] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:16.974129 12496 leader_election.cc:290] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [CANDIDATE]: Term 11 election: Requested vote from peers b15891c9ffe346c28878d91e55a1628b (127.11.83.65:42619), efde4047cf9a4c4aaae40355613e94a9 (127.11.83.66:37413)
I20260618 20:07:16.974373 12293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "1afb08504e25405282a61e5751299960" candidate_term: 11 candidate_status { last_received { term: 10 index: 19 } } ignore_live_leader: false dest_uuid: "b15891c9ffe346c28878d91e55a1628b"
I20260618 20:07:16.974400 12369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "1afb08504e25405282a61e5751299960" candidate_term: 11 candidate_status { last_received { term: 10 index: 19 } } ignore_live_leader: false dest_uuid: "efde4047cf9a4c4aaae40355613e94a9"
I20260618 20:07:16.974483 12293 raft_consensus.cc:2393] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1afb08504e25405282a61e5751299960 in current term 11: Already voted for candidate b15891c9ffe346c28878d91e55a1628b in this term.
I20260618 20:07:16.975071 12369 raft_consensus.cc:2468] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1afb08504e25405282a61e5751299960 in term 11.
I20260618 20:07:16.975278 12407 leader_election.cc:304] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1afb08504e25405282a61e5751299960, efde4047cf9a4c4aaae40355613e94a9; no voters: b15891c9ffe346c28878d91e55a1628b
I20260618 20:07:16.975385 12496 raft_consensus.cc:2804] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 11 FOLLOWER]: Leader election won for term 11
I20260618 20:07:16.975488 12496 raft_consensus.cc:697] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 11 LEADER]: Becoming Leader. State: Replica: 1afb08504e25405282a61e5751299960, State: Running, Role: LEADER
I20260618 20:07:16.975554 12496 consensus_queue.cc:237] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 10.19, Last appended by leader: 19, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:16.997344 12536 raft_consensus.cc:493] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 20:07:16.997452 12536 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 11 FOLLOWER]: Advancing to term 12
I20260618 20:07:16.998308 11597 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 27efdea2abde47a79f10b10a385696ba [term 1 LEADER]: Raft consensus shutting down.
I20260618 20:07:16.998405 11597 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 27efdea2abde47a79f10b10a385696ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 20:07:16.998440 11597 tablet_replica.cc:333] T 00000000000000000000000000000000 P 27efdea2abde47a79f10b10a385696ba: stopping tablet replica
I20260618 20:07:16.998557 12536 raft_consensus.cc:515] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:16.998736 12536 leader_election.cc:290] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [CANDIDATE]: Term 12 election: Requested vote from peers 1afb08504e25405282a61e5751299960 (127.11.83.67:45079), efde4047cf9a4c4aaae40355613e94a9 (127.11.83.66:37413)
I20260618 20:07:16.999056 12442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "b15891c9ffe346c28878d91e55a1628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 19 } } ignore_live_leader: false dest_uuid: "1afb08504e25405282a61e5751299960"
I20260618 20:07:16.999215 12369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33074adf121e4604ad57da8b01cc5ae0" candidate_uuid: "b15891c9ffe346c28878d91e55a1628b" candidate_term: 12 candidate_status { last_received { term: 10 index: 19 } } ignore_live_leader: false dest_uuid: "efde4047cf9a4c4aaae40355613e94a9"
I20260618 20:07:16.999277 12369 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 11 FOLLOWER]: Advancing to term 12
I20260618 20:07:16.999975 12369 raft_consensus.cc:2468] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b15891c9ffe346c28878d91e55a1628b in term 12.
I20260618 20:07:17.000169 12256 leader_election.cc:304] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b15891c9ffe346c28878d91e55a1628b, efde4047cf9a4c4aaae40355613e94a9; no voters: 1afb08504e25405282a61e5751299960
I20260618 20:07:17.000285 12536 raft_consensus.cc:2804] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 12 FOLLOWER]: Leader election won for term 12
I20260618 20:07:17.000384 12536 raft_consensus.cc:697] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 12 LEADER]: Becoming Leader. State: Replica: b15891c9ffe346c28878d91e55a1628b, State: Running, Role: LEADER
I20260618 20:07:17.000447 12536 consensus_queue.cc:237] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 10.19, Last appended by leader: 19, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:17.012162 11597 master.cc:584] Master@127.11.83.126:42843 shutdown complete.
I20260618 20:07:17.014000 11597 tablet_server.cc:179] TabletServer@127.11.83.65:0 shutting down...
I20260618 20:07:17.056496 11597 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260618 20:07:17.056726 11597 tablet_replica.cc:333] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b: stopping tablet replica
I20260618 20:07:17.056804 11597 raft_consensus.cc:2243] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 12 LEADER]: Raft consensus shutting down.
I20260618 20:07:17.056885 11597 pending_rounds.cc:70] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b: Trying to abort 1 pending ops.
I20260618 20:07:17.056915 11597 pending_rounds.cc:77] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b: Aborting op as it isn't in flight: id { term: 12 index: 20 } timestamp: 7298307018754416640 op_type: NO_OP noop_request { }
I20260618 20:07:17.056985 11597 raft_consensus.cc:2889] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 12 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260618 20:07:17.057025 11597 raft_consensus.cc:2272] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260618 20:07:17.069582 11597 tablet_server.cc:196] TabletServer@127.11.83.65:0 shutdown complete.
I20260618 20:07:17.070868 11597 tablet_server.cc:179] TabletServer@127.11.83.66:0 shutting down...
I20260618 20:07:17.075941 11597 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260618 20:07:17.076098 11597 tablet_replica.cc:333] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9: stopping tablet replica
I20260618 20:07:17.076182 11597 raft_consensus.cc:2243] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260618 20:07:17.076257 11597 raft_consensus.cc:2272] T 33074adf121e4604ad57da8b01cc5ae0 P efde4047cf9a4c4aaae40355613e94a9 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260618 20:07:17.081357 12407 consensus_peers.cc:597] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 -> Peer efde4047cf9a4c4aaae40355613e94a9 (127.11.83.66:37413): Couldn't send request to peer efde4047cf9a4c4aaae40355613e94a9. Status: Network error: Client connection negotiation failed: client connection to 127.11.83.66:37413: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260618 20:07:17.088450 11597 tablet_server.cc:196] TabletServer@127.11.83.66:0 shutdown complete.
I20260618 20:07:17.089419 11597 tablet_server.cc:179] TabletServer@127.11.83.67:0 shutting down...
W20260618 20:07:17.096999 12408 consensus_peers.cc:597] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 -> Peer b15891c9ffe346c28878d91e55a1628b (127.11.83.65:42619): Couldn't send request to peer b15891c9ffe346c28878d91e55a1628b. Status: Network error: Client connection negotiation failed: client connection to 127.11.83.65:42619: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260618 20:07:17.098313 11597 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260618 20:07:17.098483 11597 tablet_replica.cc:333] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960: stopping tablet replica
I20260618 20:07:17.098546 11597 raft_consensus.cc:2243] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 11 LEADER]: Raft consensus shutting down.
I20260618 20:07:17.098639 11597 pending_rounds.cc:70] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960: Trying to abort 1 pending ops.
I20260618 20:07:17.098668 11597 pending_rounds.cc:77] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960: Aborting op as it isn't in flight: id { term: 11 index: 20 } timestamp: 7298307018652360704 op_type: NO_OP noop_request { }
I20260618 20:07:17.098757 11597 raft_consensus.cc:2889] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 11 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260618 20:07:17.098790 11597 raft_consensus.cc:2272] T 33074adf121e4604ad57da8b01cc5ae0 P 1afb08504e25405282a61e5751299960 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260618 20:07:17.110883 11597 tablet_server.cc:196] TabletServer@127.11.83.67:0 shutdown complete.
I20260618 20:07:17.111845 11597 timestamp_advancement-itest.cc:282] Restarting single tablet server...
I20260618 20:07:17.111985 11597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260618 20:07:17.112076 11597 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260618 20:07:17.113346 12550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:17.113473 12547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:17.113508 12548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 20:07:17.113618 11597 server_base.cc:1061] running on GCE node
I20260618 20:07:17.113725 11597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260618 20:07:17.113761 11597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260618 20:07:17.113780 11597 hybrid_clock.cc:648] HybridClock initialized: now 1781813237113780 us; error 0 us; skew 500 ppm
I20260618 20:07:17.114471 11597 webserver.cc:533] Webserver started at http://127.11.83.65:43237/ using document root <none> and password file <none>
I20260618 20:07:17.114562 11597 fs_manager.cc:362] Metadata directory not provided
I20260618 20:07:17.114585 11597 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260618 20:07:17.115370 11597 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260618 20:07:17.116772 12557 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:17.116992 11597 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260618 20:07:17.117069 11597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781813230966404-11597-0/minicluster-data/ts-0-root
uuid: "b15891c9ffe346c28878d91e55a1628b"
format_stamp: "Formatted at 2026-06-18 20:07:14 on dist-test-slave-szgn"
I20260618 20:07:17.117159 11597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781813230966404-11597-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781813230966404-11597-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781813230966404-11597-0/minicluster-data/ts-0-root/data
Total live blocks: 5
Total live bytes: 5272
Total live bytes (after alignment): 24576
Total number of LBM containers: 6 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 20:07:17.128481 11597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 20:07:17.128721 11597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 20:07:17.128919 11597 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260618 20:07:17.129268 12564 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260618 20:07:17.129935 11597 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260618 20:07:17.129999 11597 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20260618 20:07:17.130091 11597 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260618 20:07:17.130510 11597 ts_tablet_manager.cc:616] Registered 1 tablets
I20260618 20:07:17.130563 11597 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:17.130578 12564 tablet_bootstrap.cc:492] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b: Bootstrap starting.
I20260618 20:07:17.131961 12564 tablet_bootstrap.cc:492] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260618 20:07:17.132213 12564 tablet_bootstrap.cc:492] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b: Bootstrap complete.
I20260618 20:07:17.132328 12564 ts_tablet_manager.cc:1403] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260618 20:07:17.132493 12564 raft_consensus.cc:359] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 12 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:17.132584 12564 raft_consensus.cc:740] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 12 FOLLOWER]: Becoming Follower/Learner. State: Replica: b15891c9ffe346c28878d91e55a1628b, State: Initialized, Role: FOLLOWER
I20260618 20:07:17.132650 12564 consensus_queue.cc:260] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 19, Last appended: 12.20, Last appended by leader: 20, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:17.132824 12564 ts_tablet_manager.cc:1434] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260618 20:07:17.133852 11597 rpc_server.cc:307] RPC server started. Bound to: 127.11.83.65:42619
I20260618 20:07:17.135905 12623 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.83.65:42619 every 8 connection(s)
W20260618 20:07:17.136762 12624 heartbeater.cc:412] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260618 20:07:17.147150 11597 tablet_server.cc:179] TabletServer@127.11.83.65:42619 shutting down...
I20260618 20:07:17.249753 12602 raft_consensus.cc:493] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 20:07:17.249905 12602 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 12 FOLLOWER]: Advancing to term 13
I20260618 20:07:17.250893 12602 raft_consensus.cc:515] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:17.251153 12602 leader_election.cc:290] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [CANDIDATE]: Term 13 election: Requested vote from peers 1afb08504e25405282a61e5751299960 (127.11.83.67:45079), efde4047cf9a4c4aaae40355613e94a9 (127.11.83.66:37413)
W20260618 20:07:17.252003 12558 leader_election.cc:336] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer efde4047cf9a4c4aaae40355613e94a9 (127.11.83.66:37413): Network error: Client connection negotiation failed: client connection to 127.11.83.66:37413: connect: Connection refused (error 111)
W20260618 20:07:17.252074 12558 leader_election.cc:336] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 1afb08504e25405282a61e5751299960 (127.11.83.67:45079): Network error: Client connection negotiation failed: client connection to 127.11.83.67:45079: connect: Connection refused (error 111)
I20260618 20:07:17.252099 12558 leader_election.cc:304] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b15891c9ffe346c28878d91e55a1628b; no voters: 1afb08504e25405282a61e5751299960, efde4047cf9a4c4aaae40355613e94a9
I20260618 20:07:17.252177 12602 raft_consensus.cc:2749] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260618 20:07:17.366854 12602 raft_consensus.cc:493] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 20:07:17.366974 12602 raft_consensus.cc:3060] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 13 FOLLOWER]: Advancing to term 14
I20260618 20:07:17.367674 12602 raft_consensus.cc:515] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1afb08504e25405282a61e5751299960" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 45079 } } peers { permanent_uuid: "b15891c9ffe346c28878d91e55a1628b" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 42619 } } peers { permanent_uuid: "efde4047cf9a4c4aaae40355613e94a9" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 37413 } }
I20260618 20:07:17.367877 12602 leader_election.cc:290] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [CANDIDATE]: Term 14 election: Requested vote from peers 1afb08504e25405282a61e5751299960 (127.11.83.67:45079), efde4047cf9a4c4aaae40355613e94a9 (127.11.83.66:37413)
W20260618 20:07:17.368634 12558 leader_election.cc:336] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 1afb08504e25405282a61e5751299960 (127.11.83.67:45079): Network error: Client connection negotiation failed: client connection to 127.11.83.67:45079: connect: Connection refused (error 111)
W20260618 20:07:17.368692 12558 leader_election.cc:336] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer efde4047cf9a4c4aaae40355613e94a9 (127.11.83.66:37413): Network error: Client connection negotiation failed: client connection to 127.11.83.66:37413: connect: Connection refused (error 111)
I20260618 20:07:17.368708 12558 leader_election.cc:304] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b15891c9ffe346c28878d91e55a1628b; no voters: 1afb08504e25405282a61e5751299960, efde4047cf9a4c4aaae40355613e94a9
I20260618 20:07:17.368798 12602 raft_consensus.cc:2749] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260618 20:07:17.386405 11597 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260618 20:07:17.386662 11597 tablet_replica.cc:333] stopping tablet replica
I20260618 20:07:17.386760 11597 raft_consensus.cc:2243] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260618 20:07:17.386840 11597 pending_rounds.cc:70] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b: Trying to abort 1 pending ops.
I20260618 20:07:17.386873 11597 pending_rounds.cc:77] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b: Aborting op as it isn't in flight: id { term: 12 index: 20 } timestamp: 7298307018754416640 op_type: NO_OP noop_request { }
I20260618 20:07:17.386934 11597 raft_consensus.cc:2889] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260618 20:07:17.386970 11597 raft_consensus.cc:2272] T 33074adf121e4604ad57da8b01cc5ae0 P b15891c9ffe346c28878d91e55a1628b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260618 20:07:17.399091 11597 tablet_server.cc:196] TabletServer@127.11.83.65:42619 shutdown complete.
[ OK ] TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap (2922 ms)
[ RUN ] TimestampAdvancementITest.Kudu2463Test
I20260618 20:07:17.404047 11597 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.83.126:36211
I20260618 20:07:17.404258 11597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260618 20:07:17.405517 12632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:17.405632 12631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:17.405632 12634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 20:07:17.405954 11597 server_base.cc:1061] running on GCE node
I20260618 20:07:17.406100 11597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260618 20:07:17.406134 11597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260618 20:07:17.406148 11597 hybrid_clock.cc:648] HybridClock initialized: now 1781813237406148 us; error 0 us; skew 500 ppm
I20260618 20:07:17.406685 11597 webserver.cc:533] Webserver started at http://127.11.83.126:43255/ using document root <none> and password file <none>
I20260618 20:07:17.406754 11597 fs_manager.cc:362] Metadata directory not provided
I20260618 20:07:17.406788 11597 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 20:07:17.406822 11597 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 20:07:17.407059 11597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781813230966404-11597-0/minicluster-data/master-0-root/instance:
uuid: "4cb82af6cfd64e0c9c81ecdb1c2256f6"
format_stamp: "Formatted at 2026-06-18 20:07:17 on dist-test-slave-szgn"
I20260618 20:07:17.407899 11597 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260618 20:07:17.408349 12639 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:17.408483 11597 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:17.408537 11597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781813230966404-11597-0/minicluster-data/master-0-root
uuid: "4cb82af6cfd64e0c9c81ecdb1c2256f6"
format_stamp: "Formatted at 2026-06-18 20:07:17 on dist-test-slave-szgn"
I20260618 20:07:17.408571 11597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781813230966404-11597-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781813230966404-11597-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781813230966404-11597-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 20:07:17.415777 11597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 20:07:17.415949 11597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 20:07:17.418860 11597 rpc_server.cc:307] RPC server started. Bound to: 127.11.83.126:36211
I20260618 20:07:17.419842 12691 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.83.126:36211 every 8 connection(s)
I20260618 20:07:17.420001 12692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 20:07:17.421041 12692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cb82af6cfd64e0c9c81ecdb1c2256f6: Bootstrap starting.
I20260618 20:07:17.421366 12692 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4cb82af6cfd64e0c9c81ecdb1c2256f6: Neither blocks nor log segments found. Creating new log.
I20260618 20:07:17.421998 12692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cb82af6cfd64e0c9c81ecdb1c2256f6: No bootstrap required, opened a new log
I20260618 20:07:17.422215 12692 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4cb82af6cfd64e0c9c81ecdb1c2256f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cb82af6cfd64e0c9c81ecdb1c2256f6" member_type: VOTER }
I20260618 20:07:17.422279 12692 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4cb82af6cfd64e0c9c81ecdb1c2256f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 20:07:17.422294 12692 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4cb82af6cfd64e0c9c81ecdb1c2256f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cb82af6cfd64e0c9c81ecdb1c2256f6, State: Initialized, Role: FOLLOWER
I20260618 20:07:17.422354 12692 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4cb82af6cfd64e0c9c81ecdb1c2256f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cb82af6cfd64e0c9c81ecdb1c2256f6" member_type: VOTER }
I20260618 20:07:17.422391 12692 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4cb82af6cfd64e0c9c81ecdb1c2256f6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 20:07:17.422427 12692 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4cb82af6cfd64e0c9c81ecdb1c2256f6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 20:07:17.422454 12692 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4cb82af6cfd64e0c9c81ecdb1c2256f6 [term 0 FOLLOWER]: Advancing to term 1
I20260618 20:07:17.422976 12692 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4cb82af6cfd64e0c9c81ecdb1c2256f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cb82af6cfd64e0c9c81ecdb1c2256f6" member_type: VOTER }
I20260618 20:07:17.423046 12692 leader_election.cc:304] T 00000000000000000000000000000000 P 4cb82af6cfd64e0c9c81ecdb1c2256f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4cb82af6cfd64e0c9c81ecdb1c2256f6; no voters:
I20260618 20:07:17.423179 12692 leader_election.cc:290] T 00000000000000000000000000000000 P 4cb82af6cfd64e0c9c81ecdb1c2256f6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 20:07:17.423260 12695 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4cb82af6cfd64e0c9c81ecdb1c2256f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 20:07:17.423343 12692 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4cb82af6cfd64e0c9c81ecdb1c2256f6 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 20:07:17.423399 12695 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4cb82af6cfd64e0c9c81ecdb1c2256f6 [term 1 LEADER]: Becoming Leader. State: Replica: 4cb82af6cfd64e0c9c81ecdb1c2256f6, State: Running, Role: LEADER
I20260618 20:07:17.423460 12695 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4cb82af6cfd64e0c9c81ecdb1c2256f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cb82af6cfd64e0c9c81ecdb1c2256f6" member_type: VOTER }
I20260618 20:07:17.423673 12696 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cb82af6cfd64e0c9c81ecdb1c2256f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4cb82af6cfd64e0c9c81ecdb1c2256f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cb82af6cfd64e0c9c81ecdb1c2256f6" member_type: VOTER } }
I20260618 20:07:17.423763 12696 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cb82af6cfd64e0c9c81ecdb1c2256f6 [sys.catalog]: This master's current role is: LEADER
I20260618 20:07:17.423900 12697 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cb82af6cfd64e0c9c81ecdb1c2256f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4cb82af6cfd64e0c9c81ecdb1c2256f6. Latest consensus state: current_term: 1 leader_uuid: "4cb82af6cfd64e0c9c81ecdb1c2256f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cb82af6cfd64e0c9c81ecdb1c2256f6" member_type: VOTER } }
I20260618 20:07:17.423928 12700 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260618 20:07:17.423967 12697 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cb82af6cfd64e0c9c81ecdb1c2256f6 [sys.catalog]: This master's current role is: LEADER
I20260618 20:07:17.424106 12700 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260618 20:07:17.424680 12700 catalog_manager.cc:1382] Generated new cluster ID: fa97562360e34499904ae1aaf9c13d3f
I20260618 20:07:17.424738 12700 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260618 20:07:17.424759 11597 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260618 20:07:17.436535 12700 catalog_manager.cc:1405] Generated new certificate authority record
I20260618 20:07:17.437050 12700 catalog_manager.cc:1539] Loading token signing keys...
I20260618 20:07:17.451503 12700 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 4cb82af6cfd64e0c9c81ecdb1c2256f6: Generated new TSK 0
I20260618 20:07:17.451642 12700 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260618 20:07:17.456660 11597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260618 20:07:17.458232 12713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:17.458318 12716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 20:07:17.458266 11597 server_base.cc:1061] running on GCE node
W20260618 20:07:17.458243 12714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 20:07:17.458556 11597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260618 20:07:17.458596 11597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260618 20:07:17.458621 11597 hybrid_clock.cc:648] HybridClock initialized: now 1781813237458620 us; error 0 us; skew 500 ppm
I20260618 20:07:17.459267 11597 webserver.cc:533] Webserver started at http://127.11.83.65:34985/ using document root <none> and password file <none>
I20260618 20:07:17.459368 11597 fs_manager.cc:362] Metadata directory not provided
I20260618 20:07:17.459424 11597 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 20:07:17.459471 11597 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 20:07:17.459751 11597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781813230966404-11597-0/minicluster-data/ts-0-root/instance:
uuid: "9a2a55838595414bba9dd3f7f4e4cfe9"
format_stamp: "Formatted at 2026-06-18 20:07:17 on dist-test-slave-szgn"
I20260618 20:07:17.460668 11597 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260618 20:07:17.461136 12721 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:17.461273 11597 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:17.461331 11597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781813230966404-11597-0/minicluster-data/ts-0-root
uuid: "9a2a55838595414bba9dd3f7f4e4cfe9"
format_stamp: "Formatted at 2026-06-18 20:07:17 on dist-test-slave-szgn"
I20260618 20:07:17.461382 11597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781813230966404-11597-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781813230966404-11597-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781813230966404-11597-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 20:07:17.466681 11597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 20:07:17.466914 11597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 20:07:17.467094 11597 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260618 20:07:17.467308 11597 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 20:07:17.467355 11597 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:17.467393 11597 ts_tablet_manager.cc:616] Registered 0 tablets
I20260618 20:07:17.467419 11597 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:17.470381 11597 rpc_server.cc:307] RPC server started. Bound to: 127.11.83.65:43069
I20260618 20:07:17.470432 12784 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.83.65:43069 every 8 connection(s)
I20260618 20:07:17.470819 11597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260618 20:07:17.472200 12790 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:17.472357 12792 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:17.472246 12789 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 20:07:17.472466 11597 server_base.cc:1061] running on GCE node
I20260618 20:07:17.472653 11597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260618 20:07:17.472718 11597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260618 20:07:17.472733 11597 hybrid_clock.cc:648] HybridClock initialized: now 1781813237472732 us; error 0 us; skew 500 ppm
I20260618 20:07:17.473398 11597 webserver.cc:533] Webserver started at http://127.11.83.66:41889/ using document root <none> and password file <none>
I20260618 20:07:17.473500 11597 fs_manager.cc:362] Metadata directory not provided
I20260618 20:07:17.473555 11597 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 20:07:17.473609 11597 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 20:07:17.473945 11597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781813230966404-11597-0/minicluster-data/ts-1-root/instance:
uuid: "5e89e7f4fb6c48c785b6b301446646ef"
format_stamp: "Formatted at 2026-06-18 20:07:17 on dist-test-slave-szgn"
I20260618 20:07:17.474892 12785 heartbeater.cc:344] Connected to a master server at 127.11.83.126:36211
I20260618 20:07:17.474947 12785 heartbeater.cc:461] Registering TS with master...
I20260618 20:07:17.475072 12785 heartbeater.cc:507] Master 127.11.83.126:36211 requested a full tablet report, sending...
I20260618 20:07:17.475232 11597 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260618 20:07:17.475322 12656 ts_manager.cc:194] Registered new tserver with Master: 9a2a55838595414bba9dd3f7f4e4cfe9 (127.11.83.65:43069)
I20260618 20:07:17.475812 12797 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:17.475945 11597 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260618 20:07:17.475994 11597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781813230966404-11597-0/minicluster-data/ts-1-root
uuid: "5e89e7f4fb6c48c785b6b301446646ef"
format_stamp: "Formatted at 2026-06-18 20:07:17 on dist-test-slave-szgn"
I20260618 20:07:17.476038 11597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781813230966404-11597-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781813230966404-11597-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781813230966404-11597-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 20:07:17.476137 12656 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44042
I20260618 20:07:17.480171 11597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 20:07:17.480376 11597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 20:07:17.480541 11597 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260618 20:07:17.480757 11597 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 20:07:17.480783 11597 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:17.480805 11597 ts_tablet_manager.cc:616] Registered 0 tablets
I20260618 20:07:17.480818 11597 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:17.483942 11597 rpc_server.cc:307] RPC server started. Bound to: 127.11.83.66:36287
I20260618 20:07:17.483969 12860 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.83.66:36287 every 8 connection(s)
I20260618 20:07:17.484349 11597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260618 20:07:17.485829 12865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 20:07:17.485935 11597 server_base.cc:1061] running on GCE node
W20260618 20:07:17.485829 12864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:17.486270 12867 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 20:07:17.486512 11597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260618 20:07:17.486565 11597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260618 20:07:17.486604 11597 hybrid_clock.cc:648] HybridClock initialized: now 1781813237486604 us; error 0 us; skew 500 ppm
I20260618 20:07:17.487323 11597 webserver.cc:533] Webserver started at http://127.11.83.67:33385/ using document root <none> and password file <none>
I20260618 20:07:17.487411 11597 fs_manager.cc:362] Metadata directory not provided
I20260618 20:07:17.487457 11597 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 20:07:17.487504 11597 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 20:07:17.487840 11597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781813230966404-11597-0/minicluster-data/ts-2-root/instance:
uuid: "74d9e556ad094563bff1529e96072ded"
format_stamp: "Formatted at 2026-06-18 20:07:17 on dist-test-slave-szgn"
I20260618 20:07:17.487859 12861 heartbeater.cc:344] Connected to a master server at 127.11.83.126:36211
I20260618 20:07:17.487924 12861 heartbeater.cc:461] Registering TS with master...
I20260618 20:07:17.488049 12861 heartbeater.cc:507] Master 127.11.83.126:36211 requested a full tablet report, sending...
I20260618 20:07:17.488301 12656 ts_manager.cc:194] Registered new tserver with Master: 5e89e7f4fb6c48c785b6b301446646ef (127.11.83.66:36287)
I20260618 20:07:17.488622 12656 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44058
I20260618 20:07:17.489012 11597 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260618 20:07:17.489655 12872 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:17.489832 11597 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260618 20:07:17.489900 11597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781813230966404-11597-0/minicluster-data/ts-2-root
uuid: "74d9e556ad094563bff1529e96072ded"
format_stamp: "Formatted at 2026-06-18 20:07:17 on dist-test-slave-szgn"
I20260618 20:07:17.489957 11597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781813230966404-11597-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781813230966404-11597-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781813230966404-11597-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 20:07:17.504633 11597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 20:07:17.504927 11597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 20:07:17.505128 11597 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260618 20:07:17.505352 11597 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 20:07:17.505398 11597 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:17.505439 11597 ts_tablet_manager.cc:616] Registered 0 tablets
I20260618 20:07:17.505465 11597 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:17.508898 11597 rpc_server.cc:307] RPC server started. Bound to: 127.11.83.67:35575
I20260618 20:07:17.508973 12935 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.83.67:35575 every 8 connection(s)
I20260618 20:07:17.512174 12936 heartbeater.cc:344] Connected to a master server at 127.11.83.126:36211
I20260618 20:07:17.512239 12936 heartbeater.cc:461] Registering TS with master...
I20260618 20:07:17.512355 12936 heartbeater.cc:507] Master 127.11.83.126:36211 requested a full tablet report, sending...
I20260618 20:07:17.512645 12656 ts_manager.cc:194] Registered new tserver with Master: 74d9e556ad094563bff1529e96072ded (127.11.83.67:35575)
I20260618 20:07:17.512979 12656 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44074
I20260618 20:07:17.513581 11597 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.004445547s
I20260618 20:07:17.526551 12656 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44096:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260618 20:07:17.526712 12656 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260618 20:07:17.531666 12749 tablet_service.cc:1511] Processing CreateTablet for tablet e55e7662a7f545849662349c82d5c45b (DEFAULT_TABLE table=test-workload [id=386e5032f814431086634f369efd0079]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 20:07:17.531857 12749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e55e7662a7f545849662349c82d5c45b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 20:07:17.531980 12825 tablet_service.cc:1511] Processing CreateTablet for tablet e55e7662a7f545849662349c82d5c45b (DEFAULT_TABLE table=test-workload [id=386e5032f814431086634f369efd0079]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 20:07:17.532087 12825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e55e7662a7f545849662349c82d5c45b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 20:07:17.533126 12957 tablet_bootstrap.cc:492] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9: Bootstrap starting.
I20260618 20:07:17.533340 12958 tablet_bootstrap.cc:492] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef: Bootstrap starting.
I20260618 20:07:17.533453 12900 tablet_service.cc:1511] Processing CreateTablet for tablet e55e7662a7f545849662349c82d5c45b (DEFAULT_TABLE table=test-workload [id=386e5032f814431086634f369efd0079]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 20:07:17.533595 12900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e55e7662a7f545849662349c82d5c45b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 20:07:17.533663 12957 tablet_bootstrap.cc:654] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9: Neither blocks nor log segments found. Creating new log.
I20260618 20:07:17.533812 12958 tablet_bootstrap.cc:654] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef: Neither blocks nor log segments found. Creating new log.
I20260618 20:07:17.534307 12957 tablet_bootstrap.cc:492] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9: No bootstrap required, opened a new log
I20260618 20:07:17.534386 12958 tablet_bootstrap.cc:492] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef: No bootstrap required, opened a new log
I20260618 20:07:17.534413 12957 ts_tablet_manager.cc:1403] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260618 20:07:17.534437 12958 ts_tablet_manager.cc:1403] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260618 20:07:17.534725 12958 raft_consensus.cc:359] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } }
I20260618 20:07:17.534705 12957 raft_consensus.cc:359] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } }
I20260618 20:07:17.534812 12958 raft_consensus.cc:385] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 20:07:17.534826 12957 raft_consensus.cc:385] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 20:07:17.534837 12958 raft_consensus.cc:740] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e89e7f4fb6c48c785b6b301446646ef, State: Initialized, Role: FOLLOWER
I20260618 20:07:17.534876 12957 raft_consensus.cc:740] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a2a55838595414bba9dd3f7f4e4cfe9, State: Initialized, Role: FOLLOWER
I20260618 20:07:17.534904 12958 consensus_queue.cc:260] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } }
I20260618 20:07:17.534926 12957 consensus_queue.cc:260] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } }
I20260618 20:07:17.535131 12861 heartbeater.cc:499] Master 127.11.83.126:36211 was elected leader, sending a full tablet report...
I20260618 20:07:17.535110 12958 ts_tablet_manager.cc:1434] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260618 20:07:17.535270 12957 ts_tablet_manager.cc:1434] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260618 20:07:17.535121 12961 tablet_bootstrap.cc:492] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded: Bootstrap starting.
I20260618 20:07:17.535409 12785 heartbeater.cc:499] Master 127.11.83.126:36211 was elected leader, sending a full tablet report...
I20260618 20:07:17.535858 12961 tablet_bootstrap.cc:654] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded: Neither blocks nor log segments found. Creating new log.
I20260618 20:07:17.536428 12961 tablet_bootstrap.cc:492] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded: No bootstrap required, opened a new log
I20260618 20:07:17.536471 12961 ts_tablet_manager.cc:1403] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260618 20:07:17.536589 12961 raft_consensus.cc:359] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } }
I20260618 20:07:17.536630 12961 raft_consensus.cc:385] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 20:07:17.536643 12961 raft_consensus.cc:740] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74d9e556ad094563bff1529e96072ded, State: Initialized, Role: FOLLOWER
I20260618 20:07:17.536757 12961 consensus_queue.cc:260] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } }
I20260618 20:07:17.536944 12961 ts_tablet_manager.cc:1434] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260618 20:07:17.536965 12936 heartbeater.cc:499] Master 127.11.83.126:36211 was elected leader, sending a full tablet report...
I20260618 20:07:17.588532 12962 raft_consensus.cc:493] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260618 20:07:17.588671 12962 raft_consensus.cc:515] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } }
I20260618 20:07:17.588920 12962 leader_election.cc:290] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a2a55838595414bba9dd3f7f4e4cfe9 (127.11.83.65:43069), 74d9e556ad094563bff1529e96072ded (127.11.83.67:35575)
I20260618 20:07:17.591907 12759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55e7662a7f545849662349c82d5c45b" candidate_uuid: "5e89e7f4fb6c48c785b6b301446646ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" is_pre_election: true
I20260618 20:07:17.591953 12910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55e7662a7f545849662349c82d5c45b" candidate_uuid: "5e89e7f4fb6c48c785b6b301446646ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74d9e556ad094563bff1529e96072ded" is_pre_election: true
I20260618 20:07:17.592058 12759 raft_consensus.cc:2468] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e89e7f4fb6c48c785b6b301446646ef in term 0.
I20260618 20:07:17.592109 12910 raft_consensus.cc:2468] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e89e7f4fb6c48c785b6b301446646ef in term 0.
I20260618 20:07:17.592227 12800 leader_election.cc:304] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e89e7f4fb6c48c785b6b301446646ef, 9a2a55838595414bba9dd3f7f4e4cfe9; no voters:
I20260618 20:07:17.592345 12962 raft_consensus.cc:2804] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260618 20:07:17.592394 12962 raft_consensus.cc:493] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260618 20:07:17.592427 12962 raft_consensus.cc:3060] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [term 0 FOLLOWER]: Advancing to term 1
I20260618 20:07:17.593150 12962 raft_consensus.cc:515] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } }
I20260618 20:07:17.593317 12962 leader_election.cc:290] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [CANDIDATE]: Term 1 election: Requested vote from peers 9a2a55838595414bba9dd3f7f4e4cfe9 (127.11.83.65:43069), 74d9e556ad094563bff1529e96072ded (127.11.83.67:35575)
I20260618 20:07:17.593493 12910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55e7662a7f545849662349c82d5c45b" candidate_uuid: "5e89e7f4fb6c48c785b6b301446646ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74d9e556ad094563bff1529e96072ded"
I20260618 20:07:17.593549 12759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55e7662a7f545849662349c82d5c45b" candidate_uuid: "5e89e7f4fb6c48c785b6b301446646ef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9"
I20260618 20:07:17.593569 12910 raft_consensus.cc:3060] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 0 FOLLOWER]: Advancing to term 1
I20260618 20:07:17.593595 12759 raft_consensus.cc:3060] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 0 FOLLOWER]: Advancing to term 1
I20260618 20:07:17.594295 12910 raft_consensus.cc:2468] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e89e7f4fb6c48c785b6b301446646ef in term 1.
I20260618 20:07:17.594347 12759 raft_consensus.cc:2468] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e89e7f4fb6c48c785b6b301446646ef in term 1.
I20260618 20:07:17.594487 12799 leader_election.cc:304] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e89e7f4fb6c48c785b6b301446646ef, 74d9e556ad094563bff1529e96072ded; no voters:
I20260618 20:07:17.594568 12962 raft_consensus.cc:2804] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [term 1 FOLLOWER]: Leader election won for term 1
I20260618 20:07:17.594727 12962 raft_consensus.cc:697] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [term 1 LEADER]: Becoming Leader. State: Replica: 5e89e7f4fb6c48c785b6b301446646ef, State: Running, Role: LEADER
I20260618 20:07:17.594769 12962 consensus_queue.cc:237] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } }
I20260618 20:07:17.595382 12656 catalog_manager.cc:5696] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e89e7f4fb6c48c785b6b301446646ef (127.11.83.66). New cstate: current_term: 1 leader_uuid: "5e89e7f4fb6c48c785b6b301446646ef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } health_report { overall_health: UNKNOWN } } }
I20260618 20:07:17.608237 12759 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260618 20:07:17.608237 12910 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 FOLLOWER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260618 20:07:17.608542 12975 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 20:07:17.608642 12967 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260618 20:07:17.629205 12835 consensus_queue.cc:237] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 1.15, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } }
I20260618 20:07:17.629809 12910 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 FOLLOWER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 15. Preceding OpId from leader: term: 1 index: 16. (index mismatch)
I20260618 20:07:17.629838 12759 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 15. Preceding OpId from leader: term: 1 index: 16. (index mismatch)
I20260618 20:07:17.630062 12975 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260618 20:07:17.630137 12962 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260618 20:07:17.630826 12975 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [term 1 LEADER]: Committing config change with OpId 1.16: config changed from index -1 to 16, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.630977 12759 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Committing config change with OpId 1.16: config changed from index -1 to 16, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.632084 12654 catalog_manager.cc:5696] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef reported cstate change: config changed from index -1 to 16, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "5e89e7f4fb6c48c785b6b301446646ef" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } health_report { overall_health: HEALTHY } } }
I20260618 20:07:17.632148 12835 consensus_queue.cc:237] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 1.16, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } }
I20260618 20:07:17.632472 12759 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 16. Preceding OpId from leader: term: 1 index: 17. (index mismatch)
I20260618 20:07:17.632495 12909 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 LEARNER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 16. Preceding OpId from leader: term: 1 index: 17. (index mismatch)
I20260618 20:07:17.632663 12910 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 LEARNER]: Committing config change with OpId 1.16: config changed from index -1 to 16, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.632694 12962 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260618 20:07:17.632853 12654 catalog_manager.cc:5374] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet e55e7662a7f545849662349c82d5c45b with cas_config_opid_index 16: no extra replica candidate found for tablet e55e7662a7f545849662349c82d5c45b (table test-workload [id=386e5032f814431086634f369efd0079]): Not found: could not select location for extra replica: not enough tablet servers to satisfy replica placement policy: the total number of registered tablet servers (3) does not allow for adding an extra replica; consider bringing up more to have at least 4 tablet servers up and running
I20260618 20:07:17.633038 12967 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260618 20:07:17.633468 12975 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [term 1 LEADER]: Committing config change with OpId 1.17: config changed from index 16 to 17, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.633594 12759 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Committing config change with OpId 1.17: config changed from index 16 to 17, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.634065 12909 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 FOLLOWER]: Committing config change with OpId 1.17: config changed from index 16 to 17, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.634670 12654 catalog_manager.cc:5696] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 reported cstate change: config changed from index 16 to 17, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e89e7f4fb6c48c785b6b301446646ef" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.635514 12835 consensus_queue.cc:237] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 1.17, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } }
I20260618 20:07:17.635964 12909 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 FOLLOWER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 17. Preceding OpId from leader: term: 1 index: 18. (index mismatch)
I20260618 20:07:17.636140 12759 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 17. Preceding OpId from leader: term: 1 index: 18. (index mismatch)
I20260618 20:07:17.636139 12962 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260618 20:07:17.636308 12962 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260618 20:07:17.636879 12967 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [term 1 LEADER]: Committing config change with OpId 1.18: config changed from index 17 to 18, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.637076 12759 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Committing config change with OpId 1.18: config changed from index 17 to 18, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.637745 12909 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 LEARNER]: Committing config change with OpId 1.18: config changed from index 17 to 18, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.637799 12655 catalog_manager.cc:5696] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef reported cstate change: config changed from index 17 to 18, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "5e89e7f4fb6c48c785b6b301446646ef" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } health_report { overall_health: HEALTHY } } }
I20260618 20:07:17.637833 12835 consensus_queue.cc:237] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 1.18, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } }
I20260618 20:07:17.638377 12758 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 18. Preceding OpId from leader: term: 1 index: 19. (index mismatch)
I20260618 20:07:17.638566 12975 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260618 20:07:17.639081 12910 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 LEARNER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 18. Preceding OpId from leader: term: 1 index: 19. (index mismatch)
I20260618 20:07:17.639081 12975 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [term 1 LEADER]: Committing config change with OpId 1.19: config changed from index 18 to 19, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.639747 12975 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260618 20:07:17.639997 12759 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Committing config change with OpId 1.19: config changed from index 18 to 19, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.640049 12910 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 FOLLOWER]: Committing config change with OpId 1.19: config changed from index 18 to 19, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.640095 12655 catalog_manager.cc:5696] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef reported cstate change: config changed from index 18 to 19, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e89e7f4fb6c48c785b6b301446646ef" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } health_report { overall_health: UNKNOWN } } }
I20260618 20:07:17.640148 12835 consensus_queue.cc:237] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 1.19, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } }
I20260618 20:07:17.641026 12909 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 FOLLOWER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 19. Preceding OpId from leader: term: 1 index: 20. (index mismatch)
I20260618 20:07:17.641086 12758 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 19. Preceding OpId from leader: term: 1 index: 20. (index mismatch)
I20260618 20:07:17.641290 12962 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260618 20:07:17.641386 12967 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260618 20:07:17.641914 12962 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [term 1 LEADER]: Committing config change with OpId 1.20: config changed from index 19 to 20, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.642795 12758 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Committing config change with OpId 1.20: config changed from index 19 to 20, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.642838 12653 catalog_manager.cc:5696] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef reported cstate change: config changed from index 19 to 20, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "5e89e7f4fb6c48c785b6b301446646ef" committed_config { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } health_report { overall_health: HEALTHY } } }
I20260618 20:07:17.643640 12909 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 LEARNER]: Committing config change with OpId 1.20: config changed from index 19 to 20, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.644510 12835 consensus_queue.cc:237] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 1.20, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } }
I20260618 20:07:17.644930 12758 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 20. Preceding OpId from leader: term: 1 index: 21. (index mismatch)
I20260618 20:07:17.644959 12909 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 LEARNER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 20. Preceding OpId from leader: term: 1 index: 21. (index mismatch)
I20260618 20:07:17.645126 12967 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260618 20:07:17.645195 12962 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260618 20:07:17.645618 12962 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [term 1 LEADER]: Committing config change with OpId 1.21: config changed from index 20 to 21, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New config: { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.645735 12758 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Committing config change with OpId 1.21: config changed from index 20 to 21, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New config: { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.645830 12909 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 FOLLOWER]: Committing config change with OpId 1.21: config changed from index 20 to 21, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New config: { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.646595 12655 catalog_manager.cc:5696] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef reported cstate change: config changed from index 20 to 21, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e89e7f4fb6c48c785b6b301446646ef" committed_config { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } health_report { overall_health: HEALTHY } } }
I20260618 20:07:17.647092 12835 consensus_queue.cc:237] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 1.21, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } }
I20260618 20:07:17.647487 12909 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 FOLLOWER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 21. Preceding OpId from leader: term: 1 index: 22. (index mismatch)
I20260618 20:07:17.647487 12758 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 21. Preceding OpId from leader: term: 1 index: 22. (index mismatch)
I20260618 20:07:17.647665 12975 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260618 20:07:17.647738 12962 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260618 20:07:17.648334 12962 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [term 1 LEADER]: Committing config change with OpId 1.22: config changed from index 21 to 22, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New config: { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.648471 12758 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Committing config change with OpId 1.22: config changed from index 21 to 22, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New config: { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.649363 12909 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 LEARNER]: Committing config change with OpId 1.22: config changed from index 21 to 22, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New config: { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.649473 12835 consensus_queue.cc:237] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 1.22, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } }
I20260618 20:07:17.649375 12654 catalog_manager.cc:5696] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 reported cstate change: config changed from index 21 to 22, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "5e89e7f4fb6c48c785b6b301446646ef" committed_config { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.649981 12758 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 22. Preceding OpId from leader: term: 1 index: 23. (index mismatch)
I20260618 20:07:17.650178 12910 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 LEARNER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 22. Preceding OpId from leader: term: 1 index: 23. (index mismatch)
I20260618 20:07:17.650168 12975 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
I20260618 20:07:17.650502 12975 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
I20260618 20:07:17.651007 12975 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [term 1 LEADER]: Committing config change with OpId 1.23: config changed from index 22 to 23, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New config: { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.651093 12758 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Committing config change with OpId 1.23: config changed from index 22 to 23, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New config: { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.651130 12910 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 FOLLOWER]: Committing config change with OpId 1.23: config changed from index 22 to 23, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New config: { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.651976 12653 catalog_manager.cc:5696] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded reported cstate change: config changed from index 22 to 23, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e89e7f4fb6c48c785b6b301446646ef" committed_config { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.652288 12835 consensus_queue.cc:237] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 1.23, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } }
I20260618 20:07:17.652616 12758 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 23. Preceding OpId from leader: term: 1 index: 24. (index mismatch)
I20260618 20:07:17.652616 12910 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 FOLLOWER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 23. Preceding OpId from leader: term: 1 index: 24. (index mismatch)
I20260618 20:07:17.652789 12975 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.000s
I20260618 20:07:17.653154 12975 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.000s
I20260618 20:07:17.653482 12992 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [term 1 LEADER]: Committing config change with OpId 1.24: config changed from index 23 to 24, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New config: { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.653642 12758 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Committing config change with OpId 1.24: config changed from index 23 to 24, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New config: { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.653869 12910 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 LEARNER]: Committing config change with OpId 1.24: config changed from index 23 to 24, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New config: { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.654799 12835 consensus_queue.cc:237] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 24, Committed index: 24, Last appended: 1.24, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } }
I20260618 20:07:17.654771 12654 catalog_manager.cc:5696] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef reported cstate change: config changed from index 23 to 24, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "5e89e7f4fb6c48c785b6b301446646ef" committed_config { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } health_report { overall_health: HEALTHY } } }
I20260618 20:07:17.655229 12910 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 LEARNER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 24. Preceding OpId from leader: term: 1 index: 25. (index mismatch)
I20260618 20:07:17.655321 12758 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 24. Preceding OpId from leader: term: 1 index: 25. (index mismatch)
I20260618 20:07:17.655412 12975 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.000s
I20260618 20:07:17.655511 12962 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.000s
I20260618 20:07:17.655956 12962 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [term 1 LEADER]: Committing config change with OpId 1.25: config changed from index 24 to 25, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.656702 12910 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 FOLLOWER]: Committing config change with OpId 1.25: config changed from index 24 to 25, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.657481 12758 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Committing config change with OpId 1.25: config changed from index 24 to 25, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.657635 12655 catalog_manager.cc:5696] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded reported cstate change: config changed from index 24 to 25, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e89e7f4fb6c48c785b6b301446646ef" committed_config { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.658468 12835 consensus_queue.cc:237] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 1.25, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } }
I20260618 20:07:17.658959 12910 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 FOLLOWER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 1 index: 26. (index mismatch)
I20260618 20:07:17.658982 12758 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 1 index: 26. (index mismatch)
I20260618 20:07:17.659129 12975 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20260618 20:07:17.659297 12967 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20260618 20:07:17.659879 12992 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [term 1 LEADER]: Committing config change with OpId 1.26: config changed from index 25 to 26, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.660028 12910 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 LEARNER]: Committing config change with OpId 1.26: config changed from index 25 to 26, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.660064 12758 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Committing config change with OpId 1.26: config changed from index 25 to 26, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.660988 12655 catalog_manager.cc:5696] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef reported cstate change: config changed from index 25 to 26, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "5e89e7f4fb6c48c785b6b301446646ef" committed_config { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } health_report { overall_health: HEALTHY } } }
I20260618 20:07:17.661022 12835 consensus_queue.cc:237] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 1.26, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } }
I20260618 20:07:17.661525 12758 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20260618 20:07:17.661661 12910 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 LEARNER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20260618 20:07:17.661685 12992 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20260618 20:07:17.661826 12975 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20260618 20:07:17.662256 12992 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [term 1 LEADER]: Committing config change with OpId 1.27: config changed from index 26 to 27, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.662448 12758 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Committing config change with OpId 1.27: config changed from index 26 to 27, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.662714 12910 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 FOLLOWER]: Committing config change with OpId 1.27: config changed from index 26 to 27, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.663436 12654 catalog_manager.cc:5696] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 reported cstate change: config changed from index 26 to 27, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e89e7f4fb6c48c785b6b301446646ef" committed_config { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.663579 12835 consensus_queue.cc:237] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 1.27, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } }
I20260618 20:07:17.664063 12909 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 FOLLOWER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20260618 20:07:17.664170 12758 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20260618 20:07:17.664304 12992 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20260618 20:07:17.664358 12962 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20260618 20:07:17.664983 12975 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [term 1 LEADER]: Committing config change with OpId 1.28: config changed from index 27 to 28, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.665095 12758 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index 27 to 28, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.665099 12909 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 LEARNER]: Committing config change with OpId 1.28: config changed from index 27 to 28, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.666108 12655 catalog_manager.cc:5696] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef reported cstate change: config changed from index 27 to 28, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "5e89e7f4fb6c48c785b6b301446646ef" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } health_report { overall_health: HEALTHY } } }
I20260618 20:07:17.666152 12835 consensus_queue.cc:237] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 1.28, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } }
I20260618 20:07:17.666535 12909 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 LEARNER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 1 index: 29. (index mismatch)
I20260618 20:07:17.666549 12758 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 1 index: 29. (index mismatch)
I20260618 20:07:17.666726 12962 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20260618 20:07:17.666779 12992 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20260618 20:07:17.666811 12641 catalog_manager.cc:5243] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet e55e7662a7f545849662349c82d5c45b with cas_config_opid_index 20: aborting the task: latest config opid_index 28; task opid_index 20
I20260618 20:07:17.667315 12975 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [term 1 LEADER]: Committing config change with OpId 1.29: config changed from index 28 to 29, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.667438 12758 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Committing config change with OpId 1.29: config changed from index 28 to 29, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.667513 12909 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 FOLLOWER]: Committing config change with OpId 1.29: config changed from index 28 to 29, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.668347 12654 catalog_manager.cc:5696] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 reported cstate change: config changed from index 28 to 29, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e89e7f4fb6c48c785b6b301446646ef" committed_config { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.668402 12835 consensus_queue.cc:237] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 1.29, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } }
I20260618 20:07:17.669004 12909 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 FOLLOWER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 29. Preceding OpId from leader: term: 1 index: 30. (index mismatch)
I20260618 20:07:17.669072 12758 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 29. Preceding OpId from leader: term: 1 index: 30. (index mismatch)
I20260618 20:07:17.669152 12992 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20260618 20:07:17.669243 12967 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20260618 20:07:17.669894 12967 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [term 1 LEADER]: Committing config change with OpId 1.30: config changed from index 29 to 30, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.670047 12758 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Committing config change with OpId 1.30: config changed from index 29 to 30, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.670943 12909 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 LEARNER]: Committing config change with OpId 1.30: config changed from index 29 to 30, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.670938 12655 catalog_manager.cc:5696] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef reported cstate change: config changed from index 29 to 30, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "5e89e7f4fb6c48c785b6b301446646ef" committed_config { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } health_report { overall_health: HEALTHY } } }
I20260618 20:07:17.671042 12835 consensus_queue.cc:237] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 30, Committed index: 30, Last appended: 1.30, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } }
I20260618 20:07:17.671556 12758 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 30. Preceding OpId from leader: term: 1 index: 31. (index mismatch)
I20260618 20:07:17.671703 12992 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20260618 20:07:17.672034 12910 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 LEARNER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 30. Preceding OpId from leader: term: 1 index: 31. (index mismatch)
I20260618 20:07:17.672283 12992 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20260618 20:07:17.672367 12962 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [term 1 LEADER]: Committing config change with OpId 1.31: config changed from index 30 to 31, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.672541 12758 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Committing config change with OpId 1.31: config changed from index 30 to 31, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.672581 12910 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 FOLLOWER]: Committing config change with OpId 1.31: config changed from index 30 to 31, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.673450 12654 catalog_manager.cc:5696] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef reported cstate change: config changed from index 30 to 31, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e89e7f4fb6c48c785b6b301446646ef" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } health_report { overall_health: UNKNOWN } } }
I20260618 20:07:17.673606 12835 consensus_queue.cc:237] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 1.31, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } }
I20260618 20:07:17.673928 12910 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 FOLLOWER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 31. Preceding OpId from leader: term: 1 index: 32. (index mismatch)
I20260618 20:07:17.674151 12758 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 31. Preceding OpId from leader: term: 1 index: 32. (index mismatch)
I20260618 20:07:17.674170 12992 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20260618 20:07:17.674320 12975 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20260618 20:07:17.674875 12975 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [term 1 LEADER]: Committing config change with OpId 1.32: config changed from index 31 to 32, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.675004 12758 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Committing config change with OpId 1.32: config changed from index 31 to 32, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.675050 12910 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 LEARNER]: Committing config change with OpId 1.32: config changed from index 31 to 32, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.676003 12653 catalog_manager.cc:5696] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 reported cstate change: config changed from index 31 to 32, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "5e89e7f4fb6c48c785b6b301446646ef" committed_config { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.676116 12835 consensus_queue.cc:237] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 32, Committed index: 32, Last appended: 1.32, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } }
I20260618 20:07:17.676467 12910 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 LEARNER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 32. Preceding OpId from leader: term: 1 index: 33. (index mismatch)
I20260618 20:07:17.676520 12758 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 32. Preceding OpId from leader: term: 1 index: 33. (index mismatch)
I20260618 20:07:17.676663 12962 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20260618 20:07:17.676719 12992 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20260618 20:07:17.677182 12962 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [term 1 LEADER]: Committing config change with OpId 1.33: config changed from index 32 to 33, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.677350 12910 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 FOLLOWER]: Committing config change with OpId 1.33: config changed from index 32 to 33, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.677884 12642 catalog_manager.cc:5243] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet e55e7662a7f545849662349c82d5c45b with cas_config_opid_index 16: aborting the task: latest config opid_index 32; task opid_index 16
I20260618 20:07:17.677920 12758 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Committing config change with OpId 1.33: config changed from index 32 to 33, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.678082 12655 catalog_manager.cc:5696] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef reported cstate change: config changed from index 32 to 33, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e89e7f4fb6c48c785b6b301446646ef" committed_config { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } health_report { overall_health: HEALTHY } } }
I20260618 20:07:17.678287 12835 consensus_queue.cc:237] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 33, Committed index: 33, Last appended: 1.33, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } }
I20260618 20:07:17.678742 12910 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 FOLLOWER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 33. Preceding OpId from leader: term: 1 index: 34. (index mismatch)
I20260618 20:07:17.678936 12992 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20260618 20:07:17.679112 12758 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 33. Preceding OpId from leader: term: 1 index: 34. (index mismatch)
I20260618 20:07:17.679323 12992 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20260618 20:07:17.679772 12967 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [term 1 LEADER]: Committing config change with OpId 1.34: config changed from index 33 to 34, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.679930 12758 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Committing config change with OpId 1.34: config changed from index 33 to 34, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.680718 12653 catalog_manager.cc:5696] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef reported cstate change: config changed from index 33 to 34, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "5e89e7f4fb6c48c785b6b301446646ef" committed_config { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } health_report { overall_health: HEALTHY } } }
I20260618 20:07:17.680738 12910 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 LEARNER]: Committing config change with OpId 1.34: config changed from index 33 to 34, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from VOTER to NON_VOTER. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: NON_VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.680984 12835 consensus_queue.cc:237] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 34, Committed index: 34, Last appended: 1.34, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } }
I20260618 20:07:17.681340 12758 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 34. Preceding OpId from leader: term: 1 index: 35. (index mismatch)
I20260618 20:07:17.681700 12992 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 35, Last known committed idx: 34, Time since last communication: 0.000s
I20260618 20:07:17.681841 12909 raft_consensus.cc:1275] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 LEARNER]: Refusing update from remote peer 5e89e7f4fb6c48c785b6b301446646ef: Log matching property violated. Preceding OpId in replica: term: 1 index: 34. Preceding OpId from leader: term: 1 index: 35. (index mismatch)
I20260618 20:07:17.681984 12641 catalog_manager.cc:5243] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet e55e7662a7f545849662349c82d5c45b with cas_config_opid_index 26: aborting the task: latest config opid_index 34; task opid_index 26
I20260618 20:07:17.681994 12992 consensus_queue.cc:1048] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [LEADER]: Connected to new peer: Peer: permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 35, Last known committed idx: 34, Time since last communication: 0.000s
I20260618 20:07:17.682461 12962 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [term 1 LEADER]: Committing config change with OpId 1.35: config changed from index 34 to 35, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New config: { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.682482 12758 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Committing config change with OpId 1.35: config changed from index 34 to 35, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New config: { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.682756 12910 raft_consensus.cc:2955] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 FOLLOWER]: Committing config change with OpId 1.35: config changed from index 34 to 35, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New config: { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.683400 11597 timestamp_advancement-itest.cc:267] GCing logs...
I20260618 20:07:17.683357 12655 catalog_manager.cc:5696] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 reported cstate change: config changed from index 34 to 35, 74d9e556ad094563bff1529e96072ded (127.11.83.67) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5e89e7f4fb6c48c785b6b301446646ef" committed_config { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } } }
I20260618 20:07:17.684659 11597 timestamp_advancement-itest.cc:267] GCing logs...
I20260618 20:07:17.686182 12641 catalog_manager.cc:5243] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet e55e7662a7f545849662349c82d5c45b with cas_config_opid_index 22: aborting the task: latest config opid_index 35; task opid_index 22
I20260618 20:07:17.686968 11597 timestamp_advancement-itest.cc:267] GCing logs...
I20260618 20:07:17.691195 11597 timestamp_advancement-itest.cc:267] GCing logs...
I20260618 20:07:17.699448 11597 timestamp_advancement-itest.cc:267] GCing logs...
I20260618 20:07:17.700285 12642 catalog_manager.cc:5243] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet e55e7662a7f545849662349c82d5c45b with cas_config_opid_index 18: aborting the task: latest config opid_index 35; task opid_index 18
I20260618 20:07:17.711617 12642 catalog_manager.cc:5243] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet e55e7662a7f545849662349c82d5c45b with cas_config_opid_index 30: aborting the task: latest config opid_index 35; task opid_index 30
I20260618 20:07:17.715718 11597 timestamp_advancement-itest.cc:267] GCing logs...
I20260618 20:07:17.717867 12642 catalog_manager.cc:5243] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet e55e7662a7f545849662349c82d5c45b with cas_config_opid_index 24: aborting the task: latest config opid_index 35; task opid_index 24
I20260618 20:07:17.718350 12643 catalog_manager.cc:5243] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet e55e7662a7f545849662349c82d5c45b with cas_config_opid_index 28: aborting the task: latest config opid_index 35; task opid_index 28
I20260618 20:07:17.723098 12642 catalog_manager.cc:5243] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet e55e7662a7f545849662349c82d5c45b with cas_config_opid_index 32: aborting the task: latest config opid_index 35; task opid_index 32
I20260618 20:07:17.741935 12640 catalog_manager.cc:5243] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet e55e7662a7f545849662349c82d5c45b with cas_config_opid_index 34: aborting the task: latest config opid_index 35; task opid_index 34
I20260618 20:07:17.748044 11597 timestamp_advancement-itest.cc:267] GCing logs...
I20260618 20:07:17.812362 11597 timestamp_advancement-itest.cc:267] GCing logs...
I20260618 20:07:17.940694 11597 timestamp_advancement-itest.cc:267] GCing logs...
I20260618 20:07:18.197000 11597 timestamp_advancement-itest.cc:267] GCing logs...
I20260618 20:07:18.197173 11597 log_reader.cc:385] T e55e7662a7f545849662349c82d5c45b: removed 1 log segments from log reader
I20260618 20:07:18.197232 11597 log.cc:1079] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9: Deleting log segment in path: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781813230966404-11597-0/minicluster-data/ts-0-root/wals/e55e7662a7f545849662349c82d5c45b/wal-000000001 (ops 1-15)
I20260618 20:07:18.197932 11597 timestamp_advancement-itest.cc:274] Shutting down cluster...
I20260618 20:07:18.198046 11597 master.cc:562] Master@127.11.83.126:36211 shutting down...
I20260618 20:07:18.417212 11597 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4cb82af6cfd64e0c9c81ecdb1c2256f6 [term 1 LEADER]: Raft consensus shutting down.
I20260618 20:07:18.417344 11597 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4cb82af6cfd64e0c9c81ecdb1c2256f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 20:07:18.417389 11597 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4cb82af6cfd64e0c9c81ecdb1c2256f6: stopping tablet replica
I20260618 20:07:18.429728 11597 master.cc:584] Master@127.11.83.126:36211 shutdown complete.
I20260618 20:07:18.431290 11597 tablet_server.cc:179] TabletServer@127.11.83.65:0 shutting down...
I20260618 20:07:18.471518 11597 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260618 20:07:18.471669 11597 tablet_replica.cc:333] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9: stopping tablet replica
I20260618 20:07:18.471736 11597 raft_consensus.cc:2243] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 20:07:18.471827 11597 raft_consensus.cc:2272] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 20:07:18.483872 11597 tablet_server.cc:196] TabletServer@127.11.83.65:0 shutdown complete.
I20260618 20:07:18.485267 11597 tablet_server.cc:179] TabletServer@127.11.83.66:0 shutting down...
W20260618 20:07:18.650480 12800 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.83.65:43069: connect: Connection refused (error 111) [suppressed 18 similar messages]
W20260618 20:07:18.651057 12800 consensus_peers.cc:597] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef -> Peer 9a2a55838595414bba9dd3f7f4e4cfe9 (127.11.83.65:43069): Couldn't send request to peer 9a2a55838595414bba9dd3f7f4e4cfe9. Status: Network error: Client connection negotiation failed: client connection to 127.11.83.65:43069: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260618 20:07:18.735234 11597 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260618 20:07:18.735494 11597 tablet_replica.cc:333] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef: stopping tablet replica
I20260618 20:07:18.735585 11597 raft_consensus.cc:2243] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [term 1 LEADER]: Raft consensus shutting down.
I20260618 20:07:18.735657 11597 raft_consensus.cc:2272] T e55e7662a7f545849662349c82d5c45b P 5e89e7f4fb6c48c785b6b301446646ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 20:07:18.747881 11597 tablet_server.cc:196] TabletServer@127.11.83.66:0 shutdown complete.
I20260618 20:07:18.748951 11597 tablet_server.cc:179] TabletServer@127.11.83.67:0 shutting down...
I20260618 20:07:18.760330 11597 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260618 20:07:18.760514 11597 tablet_replica.cc:333] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded: stopping tablet replica
I20260618 20:07:18.760632 11597 raft_consensus.cc:2243] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 20:07:18.760715 11597 raft_consensus.cc:2272] T e55e7662a7f545849662349c82d5c45b P 74d9e556ad094563bff1529e96072ded [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 20:07:18.772660 11597 tablet_server.cc:196] TabletServer@127.11.83.67:0 shutdown complete.
I20260618 20:07:18.773828 11597 timestamp_advancement-itest.cc:282] Restarting single tablet server...
I20260618 20:07:18.774055 11597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260618 20:07:18.775413 12997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:18.775476 12999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:18.775504 12996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 20:07:18.775804 11597 server_base.cc:1061] running on GCE node
I20260618 20:07:18.775949 11597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260618 20:07:18.775980 11597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260618 20:07:18.775992 11597 hybrid_clock.cc:648] HybridClock initialized: now 1781813238775993 us; error 0 us; skew 500 ppm
I20260618 20:07:18.776568 11597 webserver.cc:533] Webserver started at http://127.11.83.65:34985/ using document root <none> and password file <none>
I20260618 20:07:18.776665 11597 fs_manager.cc:362] Metadata directory not provided
I20260618 20:07:18.776742 11597 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260618 20:07:18.777539 11597 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260618 20:07:18.779009 13006 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:18.779201 11597 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260618 20:07:18.779258 11597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781813230966404-11597-0/minicluster-data/ts-0-root
uuid: "9a2a55838595414bba9dd3f7f4e4cfe9"
format_stamp: "Formatted at 2026-06-18 20:07:17 on dist-test-slave-szgn"
I20260618 20:07:18.779310 11597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781813230966404-11597-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781813230966404-11597-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781813230966404-11597-0/minicluster-data/ts-0-root/data
Total live blocks: 5
Total live bytes: 5272
Total live bytes (after alignment): 24576
Total number of LBM containers: 6 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 20:07:18.794332 11597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 20:07:18.794534 11597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 20:07:18.794682 11597 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260618 20:07:18.794999 13013 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260618 20:07:18.795615 11597 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260618 20:07:18.795665 11597 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20260618 20:07:18.795691 11597 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260618 20:07:18.796156 11597 ts_tablet_manager.cc:616] Registered 1 tablets
I20260618 20:07:18.796187 11597 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:18.796254 13013 tablet_bootstrap.cc:492] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9: Bootstrap starting.
I20260618 20:07:18.799011 13013 tablet_bootstrap.cc:492] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9: Bootstrap replayed 1/1 log segments. Stats: ops{read=20 overwritten=0 applied=20 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260618 20:07:18.799348 13013 tablet_bootstrap.cc:492] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9: Bootstrap complete.
I20260618 20:07:18.799465 13013 ts_tablet_manager.cc:1403] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260618 20:07:18.799604 13013 raft_consensus.cc:359] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } }
I20260618 20:07:18.799705 13013 raft_consensus.cc:740] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a2a55838595414bba9dd3f7f4e4cfe9, State: Initialized, Role: FOLLOWER
I20260618 20:07:18.799772 13013 consensus_queue.cc:260] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 35, Last appended: 1.35, Last appended by leader: 35, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "9a2a55838595414bba9dd3f7f4e4cfe9" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 43069 } } peers { permanent_uuid: "5e89e7f4fb6c48c785b6b301446646ef" member_type: VOTER last_known_addr { host: "127.11.83.66" port: 36287 } } peers { permanent_uuid: "74d9e556ad094563bff1529e96072ded" member_type: VOTER last_known_addr { host: "127.11.83.67" port: 35575 } }
I20260618 20:07:18.799901 11597 rpc_server.cc:307] RPC server started. Bound to: 127.11.83.65:43069
I20260618 20:07:18.799953 13013 ts_tablet_manager.cc:1434] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9: Time spent starting tablet: real 0.000s user 0.002s sys 0.000s
I20260618 20:07:18.802433 13071 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.83.65:43069 every 8 connection(s)
W20260618 20:07:18.803324 13073 heartbeater.cc:412] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260618 20:07:18.808497 13026 tablet_service.cc:3018] Rejecting scan request for tablet e55e7662a7f545849662349c82d5c45b: Uninitialized: clean time has not yet been initialized
I20260618 20:07:18.808818 11597 timestamp_advancement-itest.cc:447] Got response: error { code: TABLET_NOT_RUNNING status { code: UNINITIALIZED message: "clean time has not yet been initialized" } }
I20260618 20:07:18.809132 11597 tablet_server.cc:179] TabletServer@127.11.83.65:43069 shutting down...
I20260618 20:07:19.052969 11597 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260618 20:07:19.053203 11597 tablet_replica.cc:333] stopping tablet replica
I20260618 20:07:19.053282 11597 raft_consensus.cc:2243] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260618 20:07:19.053342 11597 raft_consensus.cc:2272] T e55e7662a7f545849662349c82d5c45b P 9a2a55838595414bba9dd3f7f4e4cfe9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 20:07:19.065263 11597 tablet_server.cc:196] TabletServer@127.11.83.65:43069 shutdown complete.
[ OK ] TimestampAdvancementITest.Kudu2463Test (1666 ms)
[ RUN ] TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp
I20260618 20:07:19.069986 11597 timestamp_advancement-itest.cc:460] Running with 1 replicas
I20260618 20:07:19.070205 11597 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.83.126:36821
I20260618 20:07:19.070334 11597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260618 20:07:19.071792 13078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:19.071931 13081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 20:07:19.071913 11597 server_base.cc:1061] running on GCE node
W20260618 20:07:19.071889 13079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 20:07:19.072165 11597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260618 20:07:19.072201 11597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260618 20:07:19.072213 11597 hybrid_clock.cc:648] HybridClock initialized: now 1781813239072214 us; error 0 us; skew 500 ppm
I20260618 20:07:19.072817 11597 webserver.cc:533] Webserver started at http://127.11.83.126:45945/ using document root <none> and password file <none>
I20260618 20:07:19.072937 11597 fs_manager.cc:362] Metadata directory not provided
I20260618 20:07:19.072988 11597 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 20:07:19.073037 11597 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 20:07:19.073307 11597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781813230966404-11597-0/minicluster-data/master-0-root/instance:
uuid: "86b0e54a338542ba8da5a175c74c1575"
format_stamp: "Formatted at 2026-06-18 20:07:19 on dist-test-slave-szgn"
I20260618 20:07:19.074383 11597 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260618 20:07:19.074939 13086 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:19.075065 11597 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260618 20:07:19.075115 11597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781813230966404-11597-0/minicluster-data/master-0-root
uuid: "86b0e54a338542ba8da5a175c74c1575"
format_stamp: "Formatted at 2026-06-18 20:07:19 on dist-test-slave-szgn"
I20260618 20:07:19.075155 11597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781813230966404-11597-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781813230966404-11597-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781813230966404-11597-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 20:07:19.080720 11597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 20:07:19.080904 11597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 20:07:19.084147 11597 rpc_server.cc:307] RPC server started. Bound to: 127.11.83.126:36821
I20260618 20:07:19.084710 13138 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.83.126:36821 every 8 connection(s)
I20260618 20:07:19.084895 13139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 20:07:19.085907 13139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575: Bootstrap starting.
I20260618 20:07:19.086266 13139 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575: Neither blocks nor log segments found. Creating new log.
I20260618 20:07:19.086828 13139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575: No bootstrap required, opened a new log
I20260618 20:07:19.086984 13139 raft_consensus.cc:359] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86b0e54a338542ba8da5a175c74c1575" member_type: VOTER }
I20260618 20:07:19.087054 13139 raft_consensus.cc:385] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 20:07:19.087102 13139 raft_consensus.cc:740] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b0e54a338542ba8da5a175c74c1575, State: Initialized, Role: FOLLOWER
I20260618 20:07:19.087154 13139 consensus_queue.cc:260] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86b0e54a338542ba8da5a175c74c1575" member_type: VOTER }
I20260618 20:07:19.087193 13139 raft_consensus.cc:399] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 20:07:19.087222 13139 raft_consensus.cc:493] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 20:07:19.087250 13139 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [term 0 FOLLOWER]: Advancing to term 1
I20260618 20:07:19.087774 13139 raft_consensus.cc:515] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86b0e54a338542ba8da5a175c74c1575" member_type: VOTER }
I20260618 20:07:19.087832 13139 leader_election.cc:304] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 86b0e54a338542ba8da5a175c74c1575; no voters:
I20260618 20:07:19.087958 13139 leader_election.cc:290] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 20:07:19.087999 13142 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 20:07:19.088131 13142 raft_consensus.cc:697] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [term 1 LEADER]: Becoming Leader. State: Replica: 86b0e54a338542ba8da5a175c74c1575, State: Running, Role: LEADER
I20260618 20:07:19.088140 13139 sys_catalog.cc:565] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 20:07:19.088202 13142 consensus_queue.cc:237] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86b0e54a338542ba8da5a175c74c1575" member_type: VOTER }
I20260618 20:07:19.088433 13144 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 86b0e54a338542ba8da5a175c74c1575. Latest consensus state: current_term: 1 leader_uuid: "86b0e54a338542ba8da5a175c74c1575" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86b0e54a338542ba8da5a175c74c1575" member_type: VOTER } }
I20260618 20:07:19.088421 13143 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "86b0e54a338542ba8da5a175c74c1575" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86b0e54a338542ba8da5a175c74c1575" member_type: VOTER } }
I20260618 20:07:19.088510 13144 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [sys.catalog]: This master's current role is: LEADER
I20260618 20:07:19.088537 13143 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [sys.catalog]: This master's current role is: LEADER
I20260618 20:07:19.088733 13146 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260618 20:07:19.088881 13146 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260618 20:07:19.089475 13146 catalog_manager.cc:1382] Generated new cluster ID: b4f21912acd04394b6bcf8bc61d870cc
I20260618 20:07:19.089519 13146 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260618 20:07:19.089550 11597 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260618 20:07:19.109349 13146 catalog_manager.cc:1405] Generated new certificate authority record
I20260618 20:07:19.109849 13146 catalog_manager.cc:1539] Loading token signing keys...
I20260618 20:07:19.118474 13146 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575: Generated new TSK 0
I20260618 20:07:19.118599 13146 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260618 20:07:19.121470 11597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260618 20:07:19.123107 13161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:19.123188 13163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:19.123188 13160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 20:07:19.123438 11597 server_base.cc:1061] running on GCE node
I20260618 20:07:19.123562 11597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260618 20:07:19.123596 11597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260618 20:07:19.123615 11597 hybrid_clock.cc:648] HybridClock initialized: now 1781813239123614 us; error 0 us; skew 500 ppm
I20260618 20:07:19.124343 11597 webserver.cc:533] Webserver started at http://127.11.83.65:36055/ using document root <none> and password file <none>
I20260618 20:07:19.124464 11597 fs_manager.cc:362] Metadata directory not provided
I20260618 20:07:19.124570 11597 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 20:07:19.124644 11597 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 20:07:19.124933 11597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781813230966404-11597-0/minicluster-data/ts-0-root/instance:
uuid: "48cb2ba17acd471283d73fd302a49f63"
format_stamp: "Formatted at 2026-06-18 20:07:19 on dist-test-slave-szgn"
I20260618 20:07:19.125932 11597 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260618 20:07:19.126677 13168 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:19.126825 11597 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:19.126878 11597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781813230966404-11597-0/minicluster-data/ts-0-root
uuid: "48cb2ba17acd471283d73fd302a49f63"
format_stamp: "Formatted at 2026-06-18 20:07:19 on dist-test-slave-szgn"
I20260618 20:07:19.126941 11597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781813230966404-11597-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781813230966404-11597-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781813230966404-11597-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 20:07:19.146394 11597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 20:07:19.146660 11597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 20:07:19.146837 11597 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260618 20:07:19.147055 11597 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 20:07:19.147084 11597 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:19.147106 11597 ts_tablet_manager.cc:616] Registered 0 tablets
I20260618 20:07:19.147119 11597 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:19.149910 11597 rpc_server.cc:307] RPC server started. Bound to: 127.11.83.65:46151
I20260618 20:07:19.149979 13231 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.83.65:46151 every 8 connection(s)
I20260618 20:07:19.153679 13232 heartbeater.cc:344] Connected to a master server at 127.11.83.126:36821
I20260618 20:07:19.153813 13232 heartbeater.cc:461] Registering TS with master...
I20260618 20:07:19.153935 13232 heartbeater.cc:507] Master 127.11.83.126:36821 requested a full tablet report, sending...
I20260618 20:07:19.154217 13103 ts_manager.cc:194] Registered new tserver with Master: 48cb2ba17acd471283d73fd302a49f63 (127.11.83.65:46151)
I20260618 20:07:19.154631 11597 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.004484549s
I20260618 20:07:19.154850 13103 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52086
I20260618 20:07:19.168030 13103 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52102:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260618 20:07:19.172567 13196 tablet_service.cc:1511] Processing CreateTablet for tablet 4a926b7b17c2476d81155d4b1ac21c70 (DEFAULT_TABLE table=test-workload [id=e0b696f1e09d47c7bede0f92f93737e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260618 20:07:19.172771 13196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a926b7b17c2476d81155d4b1ac21c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260618 20:07:19.174068 13250 tablet_bootstrap.cc:492] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63: Bootstrap starting.
I20260618 20:07:19.174417 13250 tablet_bootstrap.cc:654] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63: Neither blocks nor log segments found. Creating new log.
I20260618 20:07:19.174950 13250 tablet_bootstrap.cc:492] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63: No bootstrap required, opened a new log
I20260618 20:07:19.174996 13250 ts_tablet_manager.cc:1403] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260618 20:07:19.175089 13250 raft_consensus.cc:359] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48cb2ba17acd471283d73fd302a49f63" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 46151 } }
I20260618 20:07:19.175174 13250 raft_consensus.cc:385] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260618 20:07:19.175204 13250 raft_consensus.cc:740] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48cb2ba17acd471283d73fd302a49f63, State: Initialized, Role: FOLLOWER
I20260618 20:07:19.175293 13250 consensus_queue.cc:260] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48cb2ba17acd471283d73fd302a49f63" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 46151 } }
I20260618 20:07:19.175376 13250 raft_consensus.cc:399] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 20:07:19.175415 13250 raft_consensus.cc:493] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 20:07:19.175446 13250 raft_consensus.cc:3060] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63 [term 0 FOLLOWER]: Advancing to term 1
I20260618 20:07:19.176229 13250 raft_consensus.cc:515] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48cb2ba17acd471283d73fd302a49f63" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 46151 } }
I20260618 20:07:19.176326 13250 leader_election.cc:304] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 48cb2ba17acd471283d73fd302a49f63; no voters:
I20260618 20:07:19.176463 13250 leader_election.cc:290] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260618 20:07:19.176533 13252 raft_consensus.cc:2804] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63 [term 1 FOLLOWER]: Leader election won for term 1
I20260618 20:07:19.176630 13250 ts_tablet_manager.cc:1434] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260618 20:07:19.176657 13232 heartbeater.cc:499] Master 127.11.83.126:36821 was elected leader, sending a full tablet report...
I20260618 20:07:19.176719 13252 raft_consensus.cc:697] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63 [term 1 LEADER]: Becoming Leader. State: Replica: 48cb2ba17acd471283d73fd302a49f63, State: Running, Role: LEADER
I20260618 20:07:19.176779 13252 consensus_queue.cc:237] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48cb2ba17acd471283d73fd302a49f63" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 46151 } }
I20260618 20:07:19.177277 13103 catalog_manager.cc:5696] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48cb2ba17acd471283d73fd302a49f63 (127.11.83.65). New cstate: current_term: 1 leader_uuid: "48cb2ba17acd471283d73fd302a49f63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48cb2ba17acd471283d73fd302a49f63" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 46151 } health_report { overall_health: HEALTHY } } }
I20260618 20:07:19.178372 11597 tablet_server.cc:179] TabletServer@127.11.83.65:0 shutting down...
I20260618 20:07:19.180830 11597 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260618 20:07:19.180996 11597 tablet_replica.cc:333] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63: stopping tablet replica
I20260618 20:07:19.181080 11597 raft_consensus.cc:2243] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63 [term 1 LEADER]: Raft consensus shutting down.
I20260618 20:07:19.181133 11597 raft_consensus.cc:2272] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 20:07:19.193254 11597 tablet_server.cc:196] TabletServer@127.11.83.65:0 shutdown complete.
I20260618 20:07:19.194432 11597 master.cc:562] Master@127.11.83.126:36821 shutting down...
I20260618 20:07:19.197187 11597 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [term 1 LEADER]: Raft consensus shutting down.
I20260618 20:07:19.197279 11597 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260618 20:07:19.197356 11597 tablet_replica.cc:333] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575: stopping tablet replica
I20260618 20:07:19.209918 11597 master.cc:584] Master@127.11.83.126:36821 shutdown complete.
I20260618 20:07:19.211892 11597 timestamp_advancement-itest.cc:460] Running with 3 replicas
I20260618 20:07:19.212108 11597 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.83.126:41885
I20260618 20:07:19.212253 11597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260618 20:07:19.213910 11597 server_base.cc:1061] running on GCE node
W20260618 20:07:19.213848 13257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:19.213897 13260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:19.213848 13258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 20:07:19.214298 11597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260618 20:07:19.214334 11597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260618 20:07:19.214347 11597 hybrid_clock.cc:648] HybridClock initialized: now 1781813239214347 us; error 0 us; skew 500 ppm
I20260618 20:07:19.214915 11597 webserver.cc:533] Webserver started at http://127.11.83.126:38809/ using document root <none> and password file <none>
I20260618 20:07:19.214994 11597 fs_manager.cc:362] Metadata directory not provided
I20260618 20:07:19.215025 11597 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260618 20:07:19.215613 11597 fs_manager.cc:714] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:19.216171 13265 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:19.216322 11597 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:19.216380 11597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781813230966404-11597-0/minicluster-data/master-0-root
uuid: "86b0e54a338542ba8da5a175c74c1575"
format_stamp: "Formatted at 2026-06-18 20:07:19 on dist-test-slave-szgn"
I20260618 20:07:19.216457 11597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781813230966404-11597-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781813230966404-11597-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781813230966404-11597-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 20:07:19.230211 11597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 20:07:19.230458 11597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 20:07:19.233455 11597 rpc_server.cc:307] RPC server started. Bound to: 127.11.83.126:41885
I20260618 20:07:19.234517 13317 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.83.126:41885 every 8 connection(s)
I20260618 20:07:19.235142 13318 sys_catalog.cc:263] Verifying existing consensus state
I20260618 20:07:19.235532 13318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575: Bootstrap starting.
I20260618 20:07:19.237030 13318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=5 ignored=0} mutations{seen=2 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260618 20:07:19.237315 13318 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575: Bootstrap complete.
I20260618 20:07:19.237527 13318 raft_consensus.cc:359] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86b0e54a338542ba8da5a175c74c1575" member_type: VOTER }
I20260618 20:07:19.237584 13318 raft_consensus.cc:740] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86b0e54a338542ba8da5a175c74c1575, State: Initialized, Role: FOLLOWER
I20260618 20:07:19.237625 13318 consensus_queue.cc:260] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86b0e54a338542ba8da5a175c74c1575" member_type: VOTER }
I20260618 20:07:19.237646 13318 raft_consensus.cc:399] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 20:07:19.237659 13318 raft_consensus.cc:493] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 20:07:19.237672 13318 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [term 1 FOLLOWER]: Advancing to term 2
I20260618 20:07:19.238292 13318 raft_consensus.cc:515] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86b0e54a338542ba8da5a175c74c1575" member_type: VOTER }
I20260618 20:07:19.238351 13318 leader_election.cc:304] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 86b0e54a338542ba8da5a175c74c1575; no voters:
I20260618 20:07:19.238508 13318 leader_election.cc:290] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260618 20:07:19.238616 13321 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [term 2 FOLLOWER]: Leader election won for term 2
I20260618 20:07:19.238691 13318 sys_catalog.cc:565] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [sys.catalog]: configured and running, proceeding with master startup.
I20260618 20:07:19.238744 13321 raft_consensus.cc:697] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [term 2 LEADER]: Becoming Leader. State: Replica: 86b0e54a338542ba8da5a175c74c1575, State: Running, Role: LEADER
I20260618 20:07:19.238791 13321 consensus_queue.cc:237] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86b0e54a338542ba8da5a175c74c1575" member_type: VOTER }
I20260618 20:07:19.239078 13322 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "86b0e54a338542ba8da5a175c74c1575" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86b0e54a338542ba8da5a175c74c1575" member_type: VOTER } }
I20260618 20:07:19.239110 13323 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 86b0e54a338542ba8da5a175c74c1575. Latest consensus state: current_term: 2 leader_uuid: "86b0e54a338542ba8da5a175c74c1575" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86b0e54a338542ba8da5a175c74c1575" member_type: VOTER } }
I20260618 20:07:19.239252 13322 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [sys.catalog]: This master's current role is: LEADER
I20260618 20:07:19.239277 13323 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [sys.catalog]: This master's current role is: LEADER
I20260618 20:07:19.239431 13329 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260618 20:07:19.239718 13329 catalog_manager.cc:679] Loaded metadata for table test-workload [id=e0b696f1e09d47c7bede0f92f93737e7]
I20260618 20:07:19.239876 13329 tablet_loader.cc:96] loaded metadata for tablet 4a926b7b17c2476d81155d4b1ac21c70 (table test-workload [id=e0b696f1e09d47c7bede0f92f93737e7])
I20260618 20:07:19.239924 13329 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260618 20:07:19.239988 13329 catalog_manager.cc:1294] Loaded cluster ID: b4f21912acd04394b6bcf8bc61d870cc
I20260618 20:07:19.240022 13329 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260618 20:07:19.240085 11597 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260618 20:07:19.240818 13329 catalog_manager.cc:1539] Loading token signing keys...
I20260618 20:07:19.240957 13329 catalog_manager.cc:6080] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575: Loaded TSK: 0
I20260618 20:07:19.241089 13329 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260618 20:07:19.241390 11597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260618 20:07:19.242864 13339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:19.242973 13341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 20:07:19.243077 11597 server_base.cc:1061] running on GCE node
W20260618 20:07:19.243140 13338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 20:07:19.243263 11597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260618 20:07:19.243302 11597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260618 20:07:19.243321 11597 hybrid_clock.cc:648] HybridClock initialized: now 1781813239243322 us; error 0 us; skew 500 ppm
I20260618 20:07:19.243955 11597 webserver.cc:533] Webserver started at http://127.11.83.65:39355/ using document root <none> and password file <none>
I20260618 20:07:19.244048 11597 fs_manager.cc:362] Metadata directory not provided
I20260618 20:07:19.244079 11597 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260618 20:07:19.244606 11597 fs_manager.cc:714] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:19.245030 13346 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:19.245172 11597 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:19.245229 11597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781813230966404-11597-0/minicluster-data/ts-0-root
uuid: "48cb2ba17acd471283d73fd302a49f63"
format_stamp: "Formatted at 2026-06-18 20:07:19 on dist-test-slave-szgn"
I20260618 20:07:19.245297 11597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781813230966404-11597-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781813230966404-11597-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781813230966404-11597-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 20:07:19.270129 11597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 20:07:19.270408 11597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 20:07:19.270597 11597 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260618 20:07:19.271512 11597 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260618 20:07:19.271605 11597 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20260618 20:07:19.272073 11597 ts_tablet_manager.cc:616] Registered 1 tablets
I20260618 20:07:19.272126 13353 tablet_bootstrap.cc:492] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63: Bootstrap starting.
I20260618 20:07:19.272133 11597 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:19.273625 13353 tablet_bootstrap.cc:492] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260618 20:07:19.273885 13353 tablet_bootstrap.cc:492] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63: Bootstrap complete.
I20260618 20:07:19.273995 13353 ts_tablet_manager.cc:1403] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260618 20:07:19.274164 13353 raft_consensus.cc:359] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48cb2ba17acd471283d73fd302a49f63" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 46151 } }
I20260618 20:07:19.274235 13353 raft_consensus.cc:740] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48cb2ba17acd471283d73fd302a49f63, State: Initialized, Role: FOLLOWER
I20260618 20:07:19.274310 13353 consensus_queue.cc:260] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48cb2ba17acd471283d73fd302a49f63" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 46151 } }
I20260618 20:07:19.274351 13353 raft_consensus.cc:399] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260618 20:07:19.274376 13353 raft_consensus.cc:493] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260618 20:07:19.274411 13353 raft_consensus.cc:3060] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63 [term 1 FOLLOWER]: Advancing to term 2
I20260618 20:07:19.275065 13353 raft_consensus.cc:515] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48cb2ba17acd471283d73fd302a49f63" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 46151 } }
I20260618 20:07:19.275156 13353 leader_election.cc:304] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 48cb2ba17acd471283d73fd302a49f63; no voters:
I20260618 20:07:19.275295 13353 leader_election.cc:290] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260618 20:07:19.275341 13403 raft_consensus.cc:2804] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63 [term 2 FOLLOWER]: Leader election won for term 2
I20260618 20:07:19.275442 13353 ts_tablet_manager.cc:1434] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260618 20:07:19.275476 13403 raft_consensus.cc:697] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63 [term 2 LEADER]: Becoming Leader. State: Replica: 48cb2ba17acd471283d73fd302a49f63, State: Running, Role: LEADER
I20260618 20:07:19.275581 13403 consensus_queue.cc:237] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48cb2ba17acd471283d73fd302a49f63" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 46151 } }
I20260618 20:07:19.276173 11597 rpc_server.cc:307] RPC server started. Bound to: 127.11.83.65:33395
I20260618 20:07:19.276228 13416 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.83.65:33395 every 8 connection(s)
I20260618 20:07:19.276613 11597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260618 20:07:19.277941 13421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:19.278119 13424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:19.278220 13422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 20:07:19.279367 11597 server_base.cc:1061] running on GCE node
I20260618 20:07:19.279505 11597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260618 20:07:19.279567 11597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260618 20:07:19.279592 11597 hybrid_clock.cc:648] HybridClock initialized: now 1781813239279591 us; error 0 us; skew 500 ppm
I20260618 20:07:19.280295 13417 heartbeater.cc:344] Connected to a master server at 127.11.83.126:41885
I20260618 20:07:19.280342 11597 webserver.cc:533] Webserver started at http://127.11.83.66:33651/ using document root <none> and password file <none>
I20260618 20:07:19.280366 13417 heartbeater.cc:461] Registering TS with master...
I20260618 20:07:19.280474 11597 fs_manager.cc:362] Metadata directory not provided
I20260618 20:07:19.280530 11597 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 20:07:19.280555 13417 heartbeater.cc:507] Master 127.11.83.126:41885 requested a full tablet report, sending...
I20260618 20:07:19.280581 11597 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 20:07:19.280860 13282 ts_manager.cc:194] Registered new tserver with Master: 48cb2ba17acd471283d73fd302a49f63 (127.11.83.65:33395)
I20260618 20:07:19.280915 13282 catalog_manager.cc:5696] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "48cb2ba17acd471283d73fd302a49f63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48cb2ba17acd471283d73fd302a49f63" member_type: VOTER last_known_addr { host: "127.11.83.65" port: 46151 } health_report { overall_health: HEALTHY } } }
I20260618 20:07:19.280956 11597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781813230966404-11597-0/minicluster-data/ts-1-root/instance:
uuid: "0a2538accc5148d69a3bf462d4dcba7c"
format_stamp: "Formatted at 2026-06-18 20:07:19 on dist-test-slave-szgn"
I20260618 20:07:19.281996 11597 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260618 20:07:19.282229 13282 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50614
I20260618 20:07:19.282691 13417 heartbeater.cc:499] Master 127.11.83.126:41885 was elected leader, sending a full tablet report...
I20260618 20:07:19.282730 13430 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:19.282933 11597 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260618 20:07:19.282989 11597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781813230966404-11597-0/minicluster-data/ts-1-root
uuid: "0a2538accc5148d69a3bf462d4dcba7c"
format_stamp: "Formatted at 2026-06-18 20:07:19 on dist-test-slave-szgn"
I20260618 20:07:19.283028 11597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781813230966404-11597-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781813230966404-11597-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781813230966404-11597-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 20:07:19.296269 11597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 20:07:19.296494 11597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 20:07:19.296659 11597 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260618 20:07:19.296881 11597 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 20:07:19.296911 11597 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:19.296933 11597 ts_tablet_manager.cc:616] Registered 0 tablets
I20260618 20:07:19.296979 11597 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:19.300397 11597 rpc_server.cc:307] RPC server started. Bound to: 127.11.83.66:45413
I20260618 20:07:19.300529 13493 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.83.66:45413 every 8 connection(s)
I20260618 20:07:19.300856 11597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260618 20:07:19.302273 13500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260618 20:07:19.302274 13497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 20:07:19.302498 11597 server_base.cc:1061] running on GCE node
W20260618 20:07:19.302593 13498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260618 20:07:19.302820 11597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260618 20:07:19.302878 11597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260618 20:07:19.302902 11597 hybrid_clock.cc:648] HybridClock initialized: now 1781813239302902 us; error 0 us; skew 500 ppm
I20260618 20:07:19.303648 11597 webserver.cc:533] Webserver started at http://127.11.83.67:36007/ using document root <none> and password file <none>
I20260618 20:07:19.303807 11597 fs_manager.cc:362] Metadata directory not provided
I20260618 20:07:19.303879 11597 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260618 20:07:19.303934 11597 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260618 20:07:19.304314 11597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781813230966404-11597-0/minicluster-data/ts-2-root/instance:
uuid: "5e2adce971964ab1910587b7883b2ede"
format_stamp: "Formatted at 2026-06-18 20:07:19 on dist-test-slave-szgn"
I20260618 20:07:19.304589 13494 heartbeater.cc:344] Connected to a master server at 127.11.83.126:41885
I20260618 20:07:19.304663 13494 heartbeater.cc:461] Registering TS with master...
I20260618 20:07:19.304807 13494 heartbeater.cc:507] Master 127.11.83.126:41885 requested a full tablet report, sending...
I20260618 20:07:19.305083 13282 ts_manager.cc:194] Registered new tserver with Master: 0a2538accc5148d69a3bf462d4dcba7c (127.11.83.66:45413)
I20260618 20:07:19.305459 13282 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50616
I20260618 20:07:19.305647 11597 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260618 20:07:19.306279 13505 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:19.306460 11597 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:19.306514 11597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781813230966404-11597-0/minicluster-data/ts-2-root
uuid: "5e2adce971964ab1910587b7883b2ede"
format_stamp: "Formatted at 2026-06-18 20:07:19 on dist-test-slave-szgn"
I20260618 20:07:19.306565 11597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781813230966404-11597-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781813230966404-11597-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasklfWjWc/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781813230966404-11597-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260618 20:07:19.320528 11597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260618 20:07:19.320780 11597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260618 20:07:19.320930 11597 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260618 20:07:19.321161 11597 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260618 20:07:19.321188 11597 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:19.321230 11597 ts_tablet_manager.cc:616] Registered 0 tablets
I20260618 20:07:19.321257 11597 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260618 20:07:19.324663 11597 rpc_server.cc:307] RPC server started. Bound to: 127.11.83.67:44019
I20260618 20:07:19.324752 13568 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.83.67:44019 every 8 connection(s)
I20260618 20:07:19.328336 13569 heartbeater.cc:344] Connected to a master server at 127.11.83.126:41885
I20260618 20:07:19.328408 13569 heartbeater.cc:461] Registering TS with master...
I20260618 20:07:19.328528 13569 heartbeater.cc:507] Master 127.11.83.126:41885 requested a full tablet report, sending...
I20260618 20:07:19.328821 13282 ts_manager.cc:194] Registered new tserver with Master: 5e2adce971964ab1910587b7883b2ede (127.11.83.67:44019)
I20260618 20:07:19.329226 13282 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50628
I20260618 20:07:19.329363 11597 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.00446009s
I20260618 20:07:19.342159 11597 test_workload.cc:405] TestWorkload: Skipping table creation because table test-workload already exists
I20260618 20:07:19.342267 11597 tablet_server.cc:179] TabletServer@127.11.83.65:0 shutting down...
I20260618 20:07:19.344723 11597 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260618 20:07:19.344949 11597 tablet_replica.cc:333] stopping tablet replica
I20260618 20:07:19.345002 11597 raft_consensus.cc:2243] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63 [term 2 LEADER]: Raft consensus shutting down.
I20260618 20:07:19.345060 11597 raft_consensus.cc:2272] T 4a926b7b17c2476d81155d4b1ac21c70 P 48cb2ba17acd471283d73fd302a49f63 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260618 20:07:19.357224 11597 tablet_server.cc:196] TabletServer@127.11.83.65:0 shutdown complete.
I20260618 20:07:19.358479 11597 tablet_server.cc:179] TabletServer@127.11.83.66:0 shutting down...
I20260618 20:07:19.360891 11597 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260618 20:07:19.372448 11597 tablet_server.cc:196] TabletServer@127.11.83.66:0 shutdown complete.
I20260618 20:07:19.373395 11597 tablet_server.cc:179] TabletServer@127.11.83.67:0 shutting down...
I20260618 20:07:19.376266 11597 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260618 20:07:19.387746 11597 tablet_server.cc:196] TabletServer@127.11.83.67:0 shutdown complete.
I20260618 20:07:19.388629 11597 master.cc:562] Master@127.11.83.126:41885 shutting down...
I20260618 20:07:19.391860 11597 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [term 2 LEADER]: Raft consensus shutting down.
I20260618 20:07:19.391973 11597 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 86b0e54a338542ba8da5a175c74c1575 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260618 20:07:19.392074 11597 tablet_replica.cc:333] stopping tablet replica
I20260618 20:07:19.404104 11597 master.cc:584] Master@127.11.83.126:41885 shutdown complete.
[ OK ] TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp (338 ms)
[----------] 4 tests from TimestampAdvancementITest (8437 ms total)
[----------] Global test environment tear-down
[==========] 4 tests from 1 test suite ran. (8437 ms total)
[ PASSED ] 3 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData
1 FAILED TEST
I20260618 20:07:19.408883 11597 logging.cc:436] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/master/catalog_manager.cc:5374: suppressed but not reported on 9 messages since previous log ~1 seconds ago
I20260618 20:07:19.408939 11597 logging.cc:436] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 1 messages since previous log ~0 seconds ago
I20260618 20:07:19.408963 11597 logging.cc:436] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/tserver/ts_tablet_manager.cc:542: suppressed but not reported on 1 messages since previous log ~0 seconds ago
I20260618 20:07:19.408991 11597 logging.cc:436] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 17 messages since previous log ~5 seconds ago
I20260618 20:07:19.409058 11597 logging.cc:436] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/util/maintenance_manager.cc:346: suppressed but not reported on 103 messages since previous log ~8 seconds ago